Author Topic: Bitshares Account History Exporter  (Read 1555 times)

0 Members and 1 Guest are viewing this topic.

Offline oxarbitrage

Bitshares Account History Exporter
« on: December 29, 2017, 12:07:50 am »
By community demand here is a full account exporter tool:

http://open-explorer.io/bitshares-account-exporter/index.php

Code for the demo is open source at: https://github.com/oxarbitrage/bitshares-account-exporter

Basically it is a php that connects to an elasticsearch wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) at index.php the rest is stuff to make the form a bit prettier.

Results in CSV only available by now and not very user friendly. Looking for good feedback, can open issues at the github https://github.com/oxarbitrage/bitshares-account-exporter

Thank you all.

Technical Note: Service can go down as es-wrapper is running by flask and need to run behind nginx to handle high traffic. I am working on putting all the wrappers behind nginx to make the tools more stable.

Offline Fox

Re: Bitshares Account History Exporter
« Reply #1 on: December 29, 2017, 06:46:17 am »
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.
Witness: fox

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #2 on: December 29, 2017, 03:41:36 pm »
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.

thanks, i was able to configure the udf wrapper for TV charts(https://github.com/oxarbitrage/udf-bitshares-wrapper) under nginx today and documented the process.

that wrapper is now running with 4 processes and maximum-requests 100. This is the same setup the explorer api(https://github.com/oxarbitrage/bitshares-python-api-backend) had until today as i increased the values to 8 processes and 200 max requests as the service crashed yesterday by high traffic so this new setup will handle the grow.

the es-wrapper(https://github.com/oxarbitrage/bitshares-es-wrapper) is the one i have left to put behind nginx, this is where the exporter of this post uses to get data. i have this wrapper running on another server but i'll try to make this config today.

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #3 on: December 29, 2017, 05:34:31 pm »
Update: added nginx to the es-wrapper, now the exporter will be more stable. added with 4 processes and 100 max requests to start, will increase as it is needed.

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #4 on: January 02, 2018, 12:52:56 am »
It is needed, and thank you so much.  +5%
BTS: methodise

Offline Customminer

  • Hero Member
  • *****
  • Posts: 505
  • Bitshares FTW!
    • View Profile
    • Gridcoin.US
  • GitHub: grctest
Re: Bitshares Account History Exporter
« Reply #5 on: January 02, 2018, 02:26:07 pm »
Excellent work oxarbitrage! This will be massively helpful for tracking tax in the future :)

Keep up the great work
Hertz, Beyond Bitshares, Gridcoin!

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #6 on: January 07, 2018, 09:27:16 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.
BTS: methodise

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #7 on: January 07, 2018, 10:30:58 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.

Offline Methodise

Re: Bitshares Account History Exporter
« Reply #8 on: January 07, 2018, 10:48:40 pm »
Does not appear to be working?

200 limits aren't helpful, but I'm getting empty CSV.

i just tried it and i am not getting empty results, make sure you use your account id , not your name. make sure the dates you are using are timeframes where operations were made.

It works, I'm stupid, you're beautiful.  +5%
BTS: methodise

Offline Spoon586

  • Newbie
  • *
  • Posts: 12
    • View Profile
Re: Bitshares Account History Exporter
« Reply #9 on: June 11, 2018, 01:13:54 pm »
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.

Offline oxarbitrage

Re: Bitshares Account History Exporter
« Reply #10 on: June 17, 2018, 11:57:47 am »
Thanks for this great tool. It works very well.

Is there also a way to automatically convert the displayed trades into a better format? Only asset IDs etc. are displayed (not the coin names) and therefore do not directly show the trades.

I have to declare every single trade for tax purposes. Thus typical entries like Buy 1 ETH for xxx BTC... would be important.

let me see what i can do, ill update in the next days.

Offline Michaeldot

  • Newbie
  • *
  • Posts: 5
    • View Profile
Bitshares Account History Exporter
« Reply #11 on: June 23, 2018, 11:15:02 pm »
Hi, manage to get the latest SCALA script exporter and now its working with Photoshop CC.

Thanks SCALA for resolving this issue.

Regards
Sha

Offline Emma Lee

  • Jr. Member
  • **
  • Posts: 41
    • View Profile
  • BitShares: Bitcoin
Re: Bitshares Account History Exporter
« Reply #12 on: June 29, 2018, 05:54:02 pm »
Great work here Alfredo. I’ll work with you on the ngnix config, as I’ve been sorting that myself related to hosting an api node.

Offline Spoon586

  • Newbie
  • *
  • Posts: 12
    • View Profile
Re: Bitshares Account History Exporter
« Reply #13 on: July 10, 2018, 09:26:03 am »
Quote
let me see what i can do, ill update in the next days.

That would be absolutely great and a huge help!


Quote
Hi, manage to get the latest SCALA script exporter and now its working with Photoshop CC.

Thanks SCALA for resolving this issue.

Regards
Sha

Can you explain more about this? Does that help me in my case? Can I use this as a layman?