Gekko Forum
How long to import data ?! - Printable Version

+- Gekko Forum (https://forum.gekko.wizb.it)
+-- Forum: Exchanges (https://forum.gekko.wizb.it/forum-3.html)
+--- Forum: Kraken (https://forum.gekko.wizb.it/forum-4.html)
+--- Thread: How long to import data ?! (/thread-6.html)



How long to import data ?! - Blade - 01-04-2018

Hello,
do you have problem while importing data from kraken ? I try to import 1 month and I can't, it's hang on 1.84% and no error in the shell.
Thank you !

Edit1: Maybe this error is the problem:
(node:22427) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): TypeError: Cannot read property 'date' of undefined
(node:22427) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.


RE: How long to import data ?! - cmroche - 01-05-2018

You won't see an error on the shell if it bails out. At least this is true on the current stable branch. The develop branch has a re-done error and retry system, as well as improved importer which will report those errors... and handle them better.


RE: How long to import data ?! - Blade - 01-05-2018

Hello, I try with the dev branch.
Errors after 4.65% (1 month importing) :
(node:26609) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): TypeError: Cannot read property 'date' of undefined
(node:26609) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

Thank for your answer cmroche, (I've read a topic about your commits and I tried with your branch bitfinex_retry)


RE: How long to import data ?! - haccg - 01-07-2018

Can you try import using the commandline?
Works fine for me on develop branch


RE: How long to import data ?! - xFFFFF - 04-05-2018

In cli I have similiar error sometimes: https://forum.gekko.wizb.it/thread-56666-post-57722.html#pid57722

Speed of import is various. Sometimes its faster exchange from all supported by Gekko Big Grin


RE: How long to import data ?! - xFFFFF - 04-14-2018

If somebody have problems with import from any exchange then can download complete "image" with full exchange (Kraken in this case) history from my Google Drive.
Download datasets depend from internet connection, but should be a lot faster than import via api and gekko.

Link: https://github.com/xFFFFF/Gekko-Datasets

Datasets are updated every day.