Author Topic: Bitshares Account History Exporter  (Read 945 times)

0 Members and 1 Guest are viewing this topic.

Offline oxarbitrage

Bitshares Account History Exporter
« on: December 29, 2017, 12:07:50 am »
By community demand here is a full account exporter tool:

http://open-explorer.io/bitshares-account-exporter/index.php

Code for the demo is open source at: https://github.com/oxarbitrage/bitshares-account-exporter

Basically it is a php that connects to an elasticsearch wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) at index.php the rest is stuff to make the form a bit prettier.

Results in CSV only available by now and not very user friendly. Looking for good feedback, can open issues at the github https://github.com/oxarbitrage/bitshares-account-exporter

Thank you all.

Technical Note: Service can go down as es-wrapper is running by flask and need to run behind nginx to handle high traffic. I am working on putting all the wrappers behind nginx to make the tools more stable.

Offline Fox

Re: Bitshares Account History Exporter
« Reply #1 on: December 29, 2017, 06:46:17 am »
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.
Witness: fox

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #2 on: December 29, 2017, 03:41:36 pm »
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.

thanks, i was able to configure the udf wrapper for TV charts(https://github.com/oxarbitrage/udf-bitshares-wrapper) under nginx today and documented the process.

that wrapper is now running with 4 processes and maximum-requests 100. This is the same setup the explorer api(https://github.com/oxarbitrage/bitshares-python-api-backend) had until today as i increased the values to 8 processes and 200 max requests as the service crashed yesterday by high traffic so this new setup will handle the grow.

the es-wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) is the one i have left to put behind nginx, this is where the exporter of this post uses to get data. i have this wrapper running on another server but i'll try to make this config today.

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #3 on: December 29, 2017, 05:34:31 pm »
Update: added nginx to the es-wrapper, now the exporter will be more stable. added with 4 processes and 100 max requests to start, will increase as it is needed.

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #4 on: January 02, 2018, 12:52:56 am »
It is needed, and thank you so much.  +5%
BTS: methodise

Offline Customminer

  • Sr. Member
  • ****
  • Posts: 454
  • Bitshares FTW!
    • View Profile
    • Gridcoin.US
  • GitHub: grctest
Re: Bitshares Account History Exporter
« Reply #5 on: January 02, 2018, 02:26:07 pm »
Excellent work oxarbitrage! This will be massively helpful for tracking tax in the future :)

Keep up the great work
Hertz, Beyond Bitshares, Gridcoin!

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #6 on: January 07, 2018, 09:27:16 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.
BTS: methodise

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #7 on: January 07, 2018, 10:30:58 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #8 on: January 07, 2018, 10:48:40 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.

It works, I'm stupid, you're beautiful.  +5%
BTS: methodise

Offline Spoon586

  • Newbie
  • *
  • Posts: 11
    • View Profile
Re: Bitshares Account History Exporter
« Reply #9 on: June 11, 2018, 01:13:54 pm »
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #10 on: June 17, 2018, 11:57:47 am »
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.

let me see what i can do, ill update in the next days.