BitShares Forum

Main => General Discussion => Topic started by: oxarbitrage on December 29, 2017, 12:07:50 am

Title: Bitshares Account History Exporter
Post by: oxarbitrage on December 29, 2017, 12:07:50 am
By community demand here is a full account exporter tool:

http://open-explorer.io/bitshares-account-exporter/index.php

Code for the demo is open source at: https://github.com/oxarbitrage/bitshares-account-exporter

Basically it is a php that connects to an elasticsearch wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) at index.php the rest is stuff to make the form a bit prettier.

Results in CSV only available by now and not very user friendly. Looking for good feedback, can open issues at the github https://github.com/oxarbitrage/bitshares-account-exporter

Thank you all.

Technical Note: Service can go down as es-wrapper is running by flask and need to run behind nginx to handle high traffic. I am working on putting all the wrappers behind nginx to make the tools more stable.
Title: Re: Bitshares Account History Exporter
Post by: Fox on December 29, 2017, 06:46:17 am
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.
Title: Re: Bitshares Account History Exporter
Post by: oxarbitrage on December 29, 2017, 03:41:36 pm
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.

thanks, i was able to configure the udf wrapper for TV charts(https://github.com/oxarbitrage/udf-bitshares-wrapper) under nginx today and documented the process.

that wrapper is now running with 4 processes and maximum-requests 100. This is the same setup the explorer api(https://github.com/oxarbitrage/bitshares-python-api-backend) had until today as i increased the values to 8 processes and 200 max requests as the service crashed yesterday by high traffic so this new setup will handle the grow.

the es-wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) is the one i have left to put behind nginx, this is where the exporter of this post uses to get data. i have this wrapper running on another server but i'll try to make this config today.
Title: Re: Bitshares Account History Exporter
Post by: oxarbitrage on December 29, 2017, 05:34:31 pm
Update: added nginx to the es-wrapper, now the exporter will be more stable. added with 4 processes and 100 max requests to start, will increase as it is needed.
Title: Re: Bitshares Account History Exporter
Post by: Methodise on January 02, 2018, 12:52:56 am
It is needed, and thank you so much.  +5%
Title: Re: Bitshares Account History Exporter
Post by: R on January 02, 2018, 02:26:07 pm
Excellent work oxarbitrage! This will be massively helpful for tracking tax in the future :)

Keep up the great work
Title: Re: Bitshares Account History Exporter
Post by: Methodise on January 07, 2018, 09:27:16 pm
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.
Title: Re: Bitshares Account History Exporter
Post by: oxarbitrage on January 07, 2018, 10:30:58 pm
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.
Title: Re: Bitshares Account History Exporter
Post by: Methodise on January 07, 2018, 10:48:40 pm
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.

It works, I'm stupid, you're beautiful.  +5%
Title: Re: Bitshares Account History Exporter
Post by: Spoon586 on June 11, 2018, 01:13:54 pm
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.
Title: Re: Bitshares Account History Exporter
Post by: oxarbitrage on June 17, 2018, 11:57:47 am
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.

let me see what i can do, ill update in the next days.
Title: Bitshares Account History Exporter
Post by: Michaeldot on June 23, 2018, 11:15:02 pm
Hi, manage to get the latest SCALA script exporter and now its working with Photoshop CC.

Thanks SCALA for resolving this issue.

Regards
Sha
Title: Re: Bitshares Account History Exporter
Post by: Emma Lee on June 29, 2018, 05:54:02 pm
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.
Title: Re: Bitshares Account History Exporter
Post by: Spoon586 on July 10, 2018, 09:26:03 am
Quote
let me see what i can do, ill update in the next days.

That would be absolutely great and a huge help!


Quote
Hi, manage to get the latest SCALA script exporter and now its working with Photoshop CC.

Thanks SCALA for resolving this issue.

Regards
Sha

Can you explain more about this? Does that help me in my case? Can I use this as a layman?