I have full Binance history in datasets, but haven't webserver to share

[xFFFFF]

Maybe someone can share our webserver for Gekko datasets? I have full history of BTC and BNB pairs from Binance in Gekko format. Size is 1,5 GB. Im downloading history of bitfinex usd pairs and coinfalcon btc pairs now. This taking a lot of time, so maybe someone want use my work.

[askmike]

I am building history sets as well, I will offer them through my upcoming service. Hopefully will be able to offer all data for free as well. But that will take some months, so if you want to offer your sets until than be me guest.

Could you give a description of how much data you have per market (size + dateranges)?

[xFFFFF]

I make mistake in data, and havent full BTC history yet. Im downloading again from 1 july. I have ~70% finished. Actually size 1332M.

BNB pairs

Code:

binance    BNB    VEN    2017-11-06 06:15    2018-03-17 23:58    4 months, 1 week, 2 days, 23 hours
    binance    BNB    YOYO    2017-11-06 09:44    2018-03-17 23:58    4 months, 1 week, 2 days, 20 hours
    binance    BNB    POWR    2017-11-07 04:10    2018-03-17 23:55    4 months, 1 week, 2 days, 1 hour
    binance    BNB    NULS    2017-11-08 03:20    2018-03-17 23:38    4 months, 1 week, 1 day, 2 hours
    binance    BNB    RCN    2017-11-08 05:20    2018-03-17 23:33    4 months, 1 week, 1 day, 13 minutes
    binance    BNB    RDN    2017-11-09 11:19    2018-03-17 23:35    4 months, 6 days, 18 hours, 16 minutes
    binance    BNB    DLT    2017-11-10 08:05    2018-03-17 23:56    4 months, 5 days, 21 hours, 51 minutes
    binance    BNB    WTC    2017-11-10 09:40    2018-03-17 23:56    4 months, 5 days, 20 hours, 16 minutes
    binance    BNB    AMB    2017-11-10 16:13    2018-03-17 23:52    4 months, 5 days, 13 hours, 39 minutes
    binance    BNB    BCC    2017-11-11 08:25    2018-03-17 23:59    4 months, 4 days, 21 hours, 34 minutes
    binance    BNB    BAT    2017-11-13 11:12    2018-03-17 23:55    4 months, 2 days, 18 hours, 43 minutes
    binance    BNB    BCPT    2017-11-14 11:25    2018-03-17 23:57    4 months, 1 day, 18 hours, 32 minutes
    binance    BNB    NEO    2017-11-20 03:41    2018-03-17 23:58    3 months, 3 weeks, 5 days, 12 hours
    binance    BNB    QSP    2017-11-21 02:21    2018-03-17 23:57    3 months, 3 weeks, 4 days, 14 hours
    binance    BNB    BTS    2017-11-21 06:53    2018-03-17 23:38    3 months, 3 weeks, 4 days, 9 hours
    binance    BNB    XZC    2017-11-22 06:12    2018-03-17 23:33    3 months, 3 weeks, 3 days, 9 hours
    binance    BNB    LSK    2017-11-22 09:44    2018-03-17 23:56    3 months, 3 weeks, 3 days, 6 hours
    binance    BNB    IOTA    2017-11-28 07:47    2018-03-17 23:58    3 months, 2 weeks, 4 days, 8 hours
    binance    BNB    ADX    2017-11-29 03:13    2018-03-17 23:54    3 months, 2 weeks, 3 days, 13 hours
    binance    BNB    CMT    2017-12-05 11:59    2018-03-17 23:41    3 months, 1 week, 4 days, 4 hours
    binance    BNB    XLM    2017-12-08 06:04    2018-03-17 23:54    3 months, 1 week, 1 day, 10 hours
    binance    BNB    CND    2017-12-11 03:03    2018-03-17 23:59    3 months, 5 days, 13 hours, 26 minutes
    binance    BNB    WABI    2017-12-12 13:26    2018-03-17 23:37    3 months, 4 days, 2 hours, 41 minutes
    binance    BNB    LTC    2017-12-13 03:31    2018-03-17 23:57    3 months, 3 days, 12 hours, 56 minutes
    binance    BNB    WAVES    2017-12-15 12:32    2018-03-17 23:55    3 months, 1 day, 3 hours, 53 minutes
    binance    BNB    ICX    2017-12-18 05:12    2018-03-17 23:58    2 months, 4 weeks, 21 hours, 46 minutes
    binance    BNB    GTO    2017-12-18 08:12    2018-03-17 23:58    2 months, 4 weeks, 18 hours, 46 minutes
    binance    BNB    OST    2017-12-19 06:00    2018-03-17 23:57    2 months, 3 weeks, 6 days, 20 hours
    binance    BNB    AION    2017-12-21 08:56    2018-03-17 23:55    2 months, 3 weeks, 4 days, 17 hours
    binance    BNB    NEBL    2017-12-22 06:42    2018-03-17 23:58    2 months, 3 weeks, 3 days, 20 hours
    binance    BNB    BRD    2017-12-24 04:43    2018-03-17 23:33    2 months, 3 weeks, 1 day, 21 hours
    binance    BNB    MCO    2017-12-25 05:34    2018-03-17 23:50    2 months, 3 weeks, 21 hours, 16 minutes
    binance    BNB    NAV    2017-12-27 09:01    2018-03-17 23:55    2 months, 2 weeks, 5 days, 17 hours
    binance    BNB    TRIG    2017-12-29 06:10    2018-03-17 23:58    2 months, 2 weeks, 3 days, 20 hours
    binance    BNB    APPC    2018-01-05 16:16    2018-03-17 23:58    2 months, 1 week, 3 days, 10 hours
    binance    BNB    RLC    2018-01-12 06:45    2018-03-17 23:56    2 months, 3 days, 20 hours, 11 minutes
    binance    BNB    PIVX    2018-01-23 03:32    2018-03-17 23:45    1 month, 3 weeks, 2 days, 9 hours
    binance    BNB    STEEM    2018-02-01 09:37    2018-03-17 23:58    1 month, 2 weeks, 3 hours, 51 minutes
    binance    BNB    NANO    2018-02-02 19:56    2018-03-17 23:58    1 month, 1 week, 5 days, 17 hours
    binance    BNB    VIA    2018-02-05 07:58    2018-03-17 23:58    1 month, 1 week, 3 days, 5 hours
    binance    BNB    BLZ    2018-02-06 10:50    2018-03-17 23:33    1 month, 1 week, 2 days, 2 hours
    binance    BNB    AE    2018-02-07 11:59    2018-03-17 22:58    1 month, 1 week, 1 day, 29 minutes
    binance    BNB    RPX    2018-02-12 03:23    2018-03-17 23:56    1 month, 3 days, 10 hours, 3 minutes
    binance    BNB    NCASH    2018-02-26 10:32    2018-03-17 23:58    2 weeks, 5 days, 13 hours, 26 minutes
    binance    BNB    POA    2018-02-28 07:25    2018-03-17 23:55    2 weeks, 3 days, 16 hours, 30 minutes
    binance    BNB    ZIL    2018-03-05 06:11    2018-03-18 23:56    1 week, 6 days, 17 hours, 45 minutes
    binance    BNB    ONT    2018-03-08 06:28    2018-03-18 23:58    1 week, 3 days, 17 hours, 30 minutes
    binance    BNB    STORM    2018-03-12 06:13    2018-03-18 23:56    6 days, 17 hours, 43 minutes

469,7 MB (469692416 bytes)
After compress by bunzip2 size is ~100 MB

Coinfalcon never fetch anytrades. Its not working I think. Downloading Binance-ETC and Bitfinex-USD pairs too.

I have idea how share this via free file hosting service. But it take same days, because I want write script to download and daily autoupdate databases from my pc.

[MobiusGeek]

You could share via MEGA or any other free file hosting service as you said... I think the best way is making a single file by exchange and currency... For instance binance-bnb.zip, binance-eth.zip, binance-btc.zip, and so on...

Thanks in advance and keep the good work friend

[thegamecat]

I'm fine to share this on Gekkowarez. PM me.

[tommiehansen]

I had this problem since i enabled multi-server mode for my GAB-tool and needed a way to sync data across servers that's behind a lot of security measures etc.

So created two bash-scripts for this purpose which can be found under:
https://github.com/tommiehansen/gekko_tools

Basically these two makes it possible, for me, to easily just git pull gekko_tools from any server and sync all my strategies/toml-files/configs/history between servers that might not allow a simpler rsync method (could be Gekko instances behind firewalls, inside Docker-containers or whatever).

sync.sh
1. Compresses (tar.gz) all user-related data for Gekko (you'll have to edit the file and set *YOUR* relative path to *YOUR* Gekko folder)
2. Uploads this to transfer.sh (limit is 10 GB per file which should be enough since compression also reduces filesize by ~50% meaning you could basically have 19.8 GB of data in Gekko)
3. Outputs the link for you to share/do whatever with
4. Saves the last upload-link in sync/last.txt (for later use)
5. Removes the compressed file

It compresses these DIR's:
gekko/strategies
gekko/config
gekko/web/vue/UIconfig.js

...and this dir if the user presses 'y' (for yes):
gekko/history

This would then have to be committed somewhere so the last.txt can be synced on 2nd/3rd/4h server etc (you could simply create a fork and git pull that all the time). The core logic is there anyway so it should be very simple to modify this to do whatever one would want.

get_replace.sh
1. Gets the last url from sync/last.txt
2. Downloads the file
3. Temporarily uncompresses the data into gekko/ (under same folder -- yes)
4. Uses rsync to overwrite ../gekko/ with the files in the temporary created gekko-folder (you will need to again set *YOUR* path to *YOUR* Gekko-folder)
5. Removes the temporary Gekko-folder
6. Removes the compressed tar.gz file.

--

Anyway -- this is just one way to do it.
As said these bash scripts could easily be modified to do other things or improved to work better for more users etc.
But by using this we could basically actually sort of share history data quite easily.
Anyone could download my history data with the current scripts if they want (but they would also overwrite some of their settings with mine if they just run get_replace.sh ... so be careful).

--

The beauty in creating bash scripts is that it's "write-once-do-all-the-time". Doing all this manually would of course be quite tedious; it's a lot simpler to just run something like sync.sh and be done with it.

[Jorjaskine]

GEKKO and all visitors of the post are rushed for the back and forth items for the citizens. Scene of the visitors of the http://teacherhabits.com/5-effective-tec...sychology/ is ensured for the trust. worth is built for the GEKKO for all issues for the relevant field and tips for all shows.

[gracieanderson]

Thanks for sharing such a nice piece of information to us. This is very knowledgeable for me. I am an assignment expert and I am offering online custom coursework help to students of Australia and all over the world.

[jommendoza]

Thank you for sharing this. I was having trouble with it too

[lucifar]

I'm constantly searching on the internet for posts that will help me. Too much is clearly to learn about this. I believe you created good quality items in Functions also. Keep working, congrats!