+- Gekko Forum (https://forum.gekko.wizb.it)
+-- Forum: Gekko (https://forum.gekko.wizb.it/forum-13.html)
+--- Forum: General Discussion (https://forum.gekko.wizb.it/forum-14.html)
+--- Thread: I have full Binance history in datasets, but haven't webserver to share (/thread-56576.html)
I have full Binance history in datasets, but haven't webserver to share - xFFFFF - 03-17-2018
Maybe someone can share our webserver for Gekko datasets? I have full history of BTC and BNB pairs from Binance in Gekko format. Size is 1,5 GB. Im downloading history of bitfinex usd pairs and coinfalcon btc pairs now. This taking a lot of time, so maybe someone want use my work.
RE: I have full Binance history in datasets, but haven't webserver to share - askmike - 03-17-2018
I am building history sets as well, I will offer them through my upcoming service. Hopefully will be able to offer all data for free as well. But that will take some months, so if you want to offer your sets until than be me guest.
Could you give a description of how much data you have per market (size + dateranges)?
RE: I have full Binance history in datasets, but haven't webserver to share - xFFFFF - 03-21-2018
I make mistake in data, and havent full BTC history yet. Im downloading again from 1 july. I have ~70% finished. Actually size 1332M.
BNB pairs
Code:
binance BNB VEN 2017-11-06 06:15 2018-03-17 23:58 4 months, 1 week, 2 days, 23 hours
binance BNB YOYO 2017-11-06 09:44 2018-03-17 23:58 4 months, 1 week, 2 days, 20 hours
binance BNB POWR 2017-11-07 04:10 2018-03-17 23:55 4 months, 1 week, 2 days, 1 hour
binance BNB NULS 2017-11-08 03:20 2018-03-17 23:38 4 months, 1 week, 1 day, 2 hours
binance BNB RCN 2017-11-08 05:20 2018-03-17 23:33 4 months, 1 week, 1 day, 13 minutes
binance BNB RDN 2017-11-09 11:19 2018-03-17 23:35 4 months, 6 days, 18 hours, 16 minutes
binance BNB DLT 2017-11-10 08:05 2018-03-17 23:56 4 months, 5 days, 21 hours, 51 minutes
binance BNB WTC 2017-11-10 09:40 2018-03-17 23:56 4 months, 5 days, 20 hours, 16 minutes
binance BNB AMB 2017-11-10 16:13 2018-03-17 23:52 4 months, 5 days, 13 hours, 39 minutes
binance BNB BCC 2017-11-11 08:25 2018-03-17 23:59 4 months, 4 days, 21 hours, 34 minutes
binance BNB BAT 2017-11-13 11:12 2018-03-17 23:55 4 months, 2 days, 18 hours, 43 minutes
binance BNB BCPT 2017-11-14 11:25 2018-03-17 23:57 4 months, 1 day, 18 hours, 32 minutes
binance BNB NEO 2017-11-20 03:41 2018-03-17 23:58 3 months, 3 weeks, 5 days, 12 hours
binance BNB QSP 2017-11-21 02:21 2018-03-17 23:57 3 months, 3 weeks, 4 days, 14 hours
binance BNB BTS 2017-11-21 06:53 2018-03-17 23:38 3 months, 3 weeks, 4 days, 9 hours
binance BNB XZC 2017-11-22 06:12 2018-03-17 23:33 3 months, 3 weeks, 3 days, 9 hours
binance BNB LSK 2017-11-22 09:44 2018-03-17 23:56 3 months, 3 weeks, 3 days, 6 hours
binance BNB IOTA 2017-11-28 07:47 2018-03-17 23:58 3 months, 2 weeks, 4 days, 8 hours
binance BNB ADX 2017-11-29 03:13 2018-03-17 23:54 3 months, 2 weeks, 3 days, 13 hours
binance BNB CMT 2017-12-05 11:59 2018-03-17 23:41 3 months, 1 week, 4 days, 4 hours
binance BNB XLM 2017-12-08 06:04 2018-03-17 23:54 3 months, 1 week, 1 day, 10 hours
binance BNB CND 2017-12-11 03:03 2018-03-17 23:59 3 months, 5 days, 13 hours, 26 minutes
binance BNB WABI 2017-12-12 13:26 2018-03-17 23:37 3 months, 4 days, 2 hours, 41 minutes
binance BNB LTC 2017-12-13 03:31 2018-03-17 23:57 3 months, 3 days, 12 hours, 56 minutes
binance BNB WAVES 2017-12-15 12:32 2018-03-17 23:55 3 months, 1 day, 3 hours, 53 minutes
binance BNB ICX 2017-12-18 05:12 2018-03-17 23:58 2 months, 4 weeks, 21 hours, 46 minutes
binance BNB GTO 2017-12-18 08:12 2018-03-17 23:58 2 months, 4 weeks, 18 hours, 46 minutes
binance BNB OST 2017-12-19 06:00 2018-03-17 23:57 2 months, 3 weeks, 6 days, 20 hours
binance BNB AION 2017-12-21 08:56 2018-03-17 23:55 2 months, 3 weeks, 4 days, 17 hours
binance BNB NEBL 2017-12-22 06:42 2018-03-17 23:58 2 months, 3 weeks, 3 days, 20 hours
binance BNB BRD 2017-12-24 04:43 2018-03-17 23:33 2 months, 3 weeks, 1 day, 21 hours
binance BNB MCO 2017-12-25 05:34 2018-03-17 23:50 2 months, 3 weeks, 21 hours, 16 minutes
binance BNB NAV 2017-12-27 09:01 2018-03-17 23:55 2 months, 2 weeks, 5 days, 17 hours
binance BNB TRIG 2017-12-29 06:10 2018-03-17 23:58 2 months, 2 weeks, 3 days, 20 hours
binance BNB APPC 2018-01-05 16:16 2018-03-17 23:58 2 months, 1 week, 3 days, 10 hours
binance BNB RLC 2018-01-12 06:45 2018-03-17 23:56 2 months, 3 days, 20 hours, 11 minutes
binance BNB PIVX 2018-01-23 03:32 2018-03-17 23:45 1 month, 3 weeks, 2 days, 9 hours
binance BNB STEEM 2018-02-01 09:37 2018-03-17 23:58 1 month, 2 weeks, 3 hours, 51 minutes
binance BNB NANO 2018-02-02 19:56 2018-03-17 23:58 1 month, 1 week, 5 days, 17 hours
binance BNB VIA 2018-02-05 07:58 2018-03-17 23:58 1 month, 1 week, 3 days, 5 hours
binance BNB BLZ 2018-02-06 10:50 2018-03-17 23:33 1 month, 1 week, 2 days, 2 hours
binance BNB AE 2018-02-07 11:59 2018-03-17 22:58 1 month, 1 week, 1 day, 29 minutes
binance BNB RPX 2018-02-12 03:23 2018-03-17 23:56 1 month, 3 days, 10 hours, 3 minutes
binance BNB NCASH 2018-02-26 10:32 2018-03-17 23:58 2 weeks, 5 days, 13 hours, 26 minutes
binance BNB POA 2018-02-28 07:25 2018-03-17 23:55 2 weeks, 3 days, 16 hours, 30 minutes
binance BNB ZIL 2018-03-05 06:11 2018-03-18 23:56 1 week, 6 days, 17 hours, 45 minutes
binance BNB ONT 2018-03-08 06:28 2018-03-18 23:58 1 week, 3 days, 17 hours, 30 minutes
binance BNB STORM 2018-03-12 06:13 2018-03-18 23:56 6 days, 17 hours, 43 minutesAfter compress by bunzip2 size is ~100 MB
Coinfalcon never fetch anytrades. Its not working I think. Downloading Binance-ETC and Bitfinex-USD pairs too.
I have idea how share this via free file hosting service. But it take same days, because I want write script to download and daily autoupdate databases from my pc.
RE: I have full Binance history in datasets, but haven't webserver to share - MobiusGeek - 03-31-2018
You could share via MEGA or any other free file hosting service as you said... I think the best way is making a single file by exchange and currency... For instance binance-bnb.zip, binance-eth.zip, binance-btc.zip, and so on...
Thanks in advance and keep the good work friend
RE: I have full Binance history in datasets, but haven't webserver to share - thegamecat - 03-31-2018
I'm fine to share this on Gekkowarez. PM me.
RE: I have full Binance history in datasets, but haven't webserver to share - tommiehansen - 04-03-2018
I had this problem since i enabled multi-server mode for my GAB-tool and needed a way to sync data across servers that's behind a lot of security measures etc.
So created two bash-scripts for this purpose which can be found under:
https://github.com/tommiehansen/gekko_tools
Basically these two makes it possible, for me, to easily just git pull gekko_tools from any server and sync all my strategies/toml-files/configs/history between servers that might not allow a simpler rsync method (could be Gekko instances behind firewalls, inside Docker-containers or whatever).
sync.sh
1. Compresses (tar.gz) all user-related data for Gekko (you'll have to edit the file and set *YOUR* relative path to *YOUR* Gekko folder)
2. Uploads this to transfer.sh (limit is 10 GB per file which should be enough since compression also reduces filesize by ~50% meaning you could basically have 19.8 GB of data in Gekko)
3. Outputs the link for you to share/do whatever with
4. Saves the last upload-link in sync/last.txt (for later use)
5. Removes the compressed file
It compresses these DIR's:
gekko/strategies
gekko/config
gekko/web/vue/UIconfig.js
...and this dir if the user presses 'y' (for yes):
gekko/history
This would then have to be committed somewhere so the last.txt can be synced on 2nd/3rd/4h server etc (you could simply create a fork and git pull that all the time). The core logic is there anyway so it should be very simple to modify this to do whatever one would want.
get_replace.sh
1. Gets the last url from sync/last.txt
2. Downloads the file
3. Temporarily uncompresses the data into gekko/ (under same folder -- yes)
4. Uses rsync to overwrite ../gekko/ with the files in the temporary created gekko-folder (you will need to again set *YOUR* path to *YOUR* Gekko-folder)
5. Removes the temporary Gekko-folder
6. Removes the compressed tar.gz file.
--
Anyway -- this is just one way to do it.
As said these bash scripts could easily be modified to do other things or improved to work better for more users etc.
But by using this we could basically actually sort of share history data quite easily.
Anyone could download my history data with the current scripts if they want (but they would also overwrite some of their settings with mine if they just run get_replace.sh ... so be careful).
--
The beauty in creating bash scripts is that it's "write-once-do-all-the-time". Doing all this manually would of course be quite tedious; it's a lot simpler to just run something like sync.sh and be done with it.
RE: I have full Binance history in datasets, but haven't webserver to share - Jorjaskine - 07-17-2020
GEKKO and all visitors of the post are rushed for the back and forth items for the citizens. Scene of the visitors of the http://teacherhabits.com/5-effective-techniques-for-improving-student-performance-with-the-help-of-psychology/ is ensured for the trust. worth is built for the GEKKO for all issues for the relevant field and tips for all shows.
RE: I have full Binance history in datasets, but haven't webserver to share - gracieanderson - 08-11-2020
Thanks for sharing such a nice piece of information to us. This is very knowledgeable for me. I am an assignment expert and I am offering online custom coursework help to students of Australia and all over the world.
RE: I have full Binance history in datasets, but haven't webserver to share - jommendoza - 08-14-2020
Thank you for sharing this. I was having trouble with it too
RE: I have full Binance history in datasets, but haven't webserver to share - lucifar - 09-08-2020
I'm constantly searching on the internet for posts that will help me. Too much is clearly to learn about this. I believe you created good quality items in Functions also. Keep working, congrats!