BitShares Forum

Main => Technical Support => Topic started by: severo on August 27, 2017, 09:31:57 pm

Title: Full node and blockchain size
Post by: severo on August 27, 2017, 09:31:57 pm
Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?
Title: Re: Full node and blockchain size
Post by: JonnyB on August 28, 2017, 05:08:42 pm
you'll need a lot of ram, I think 32 gig is recommended. not sure of blockchain size
Title: Re: Full node and blockchain size
Post by: sahkan on August 28, 2017, 06:11:56 pm
Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?

The full node now runs at 42.6GB RAM, OS+node+Blockchain takes about 11.5GB Space. The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.
Title: Re: Full node and blockchain size
Post by: severo on August 28, 2017, 08:44:38 pm
Thank you very much!, it was complicated to find the accurate information on the blog 

https://bitshares.org/blog/2015/06/08/lessons-learned-from-bitshares-0.x/#keep-everything-in-memory

I'm surprised that the blockchain with all BitShares smartcoins only occupies 11.5 Gb. I also find the RAM requirements quite moderate.

Title: Re: Full node and blockchain size
Post by: paliboy on August 30, 2017, 06:31:56 am
The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.

Why is it growing so fast?
Title: Re: Full node and blockchain size
Post by: pc on August 30, 2017, 03:19:36 pm
The bulk of the data is the operation history log. There are options available to reduce the size of that significantly (by sacrificing some history, obviously). A better long-term solution will have to offload these data to disk storage (it's read-append mostly).
Title: Re: Full node and blockchain size
Post by: xeroc on September 01, 2017, 12:05:03 pm
If you do it like described here, it won't eat so much memory:
http://uptick.readthedocs.io/en/latest/public-api.html
Title: Re: Full node and blockchain size
Post by: severo on September 02, 2017, 08:36:53 pm
 Thanks a lot of!  :D
Title: Re: Full node and blockchain size
Post by: JonnyB on September 09, 2017, 11:07:14 am
When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/
Title: Re: Full node and blockchain size
Post by: sahkan on September 09, 2017, 04:55:12 pm
When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/

I think Optane is geared more towards desktops than servers. It acts like cache for your HDD more than anything.