Main Menu

Full node and blockchain size

Started by severo, August 27, 2017, 09:31:57 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

sahkan

Quote from: JonnyBitcoin on September 09, 2017, 11:07:14 AM
When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/

I think Optane is geared more towards desktops than servers. It acts like cache for your HDD more than anything. 
DEX Access:  [url="https://dexnode.net/?r=sahkan-bitshares"]https://dexnode.net/?r=sahkan-bitshares[/url]

JonnyB

When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/
I run the @bitshares twitter handle
[url="//twitter.com/bitshares"]twitter.com/bitshares[/url]

severo


xeroc


pc

The bulk of the data is the operation history log. There are options available to reduce the size of that significantly (by sacrificing some history, obviously). A better long-term solution will have to offload these data to disk storage (it's read-append mostly).
Bitcoin - Perspektive oder Risiko? ISBN 978-3-8442-6568-2 [url="http://bitcoin.quisquis.de"]http://bitcoin.quisquis.de[/url]

paliboy

Quote from: sahkan on August 28, 2017, 06:11:56 PM
The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.

Why is it growing so fast?

severo

Thank you very much!, it was complicated to find the accurate information on the blog 

https://bitshares.org/blog/2015/06/08/lessons-learned-from-bitshares-0.x/#keep-everything-in-memory

I'm surprised that the blockchain with all BitShares smartcoins only occupies 11.5 Gb. I also find the RAM requirements quite moderate.


sahkan

Quote from: erizo on August 27, 2017, 09:31:57 PM
Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?

The full node now runs at 42.6GB RAM, OS+node+Blockchain takes about 11.5GB Space. The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.
DEX Access:  [url="https://dexnode.net/?r=sahkan-bitshares"]https://dexnode.net/?r=sahkan-bitshares[/url]

JonnyB

you'll need a lot of ram, I think 32 gig is recommended. not sure of blockchain size
I run the @bitshares twitter handle
[url="//twitter.com/bitshares"]twitter.com/bitshares[/url]

severo

Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?