Author Topic: Full node and blockchain size  (Read 4874 times)

0 Members and 1 Guest are viewing this topic.

Offline sahkan

  • Sr. Member
  • ****
  • Posts: 247
    • View Profile
    • BitShares DEX
When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/

I think Optane is geared more towards desktops than servers. It acts like cache for your HDD more than anything. 

Offline JonnyB

  • Hero Member
  • *****
  • Posts: 636
    • View Profile
    • twitter.com/jonnybitcoin
When the blockchain got stuck a few months ago I remember Dan Larimer saying something about some data might get lost because of corrupted memory. I'm also aware that the full public nodes are using more and more ram every day.

There's a new memory technology from intel called optane which can be used as either RAM or storage is also non volatile in that data isn't lost when it loses power like ram does.

What do you techies make of it?

https://www.engadget.com/2017/09/07/intel-optane-explainer/
I run the @bitshares twitter handle
twitter.com/bitshares

Offline severo

  • Full Member
  • ***
  • Posts: 71
    • View Profile
 Thanks a lot of!  :D

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
If you do it like described here, it won't eat so much memory:
http://uptick.readthedocs.io/en/latest/public-api.html

Offline pc

  • Hero Member
  • *****
  • Posts: 1530
    • View Profile
    • Bitcoin - Perspektive oder Risiko?
  • BitShares: cyrano
The bulk of the data is the operation history log. There are options available to reduce the size of that significantly (by sacrificing some history, obviously). A better long-term solution will have to offload these data to disk storage (it's read-append mostly).
Bitcoin - Perspektive oder Risiko? ISBN 978-3-8442-6568-2 http://bitcoin.quisquis.de

Offline paliboy

The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.

Why is it growing so fast?

Offline severo

  • Full Member
  • ***
  • Posts: 71
    • View Profile
Thank you very much!, it was complicated to find the accurate information on the blog 

https://bitshares.org/blog/2015/06/08/lessons-learned-from-bitshares-0.x/#keep-everything-in-memory

I'm surprised that the blockchain with all BitShares smartcoins only occupies 11.5 Gb. I also find the RAM requirements quite moderate.


Offline sahkan

  • Sr. Member
  • ****
  • Posts: 247
    • View Profile
    • BitShares DEX
Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?

The full node now runs at 42.6GB RAM, OS+node+Blockchain takes about 11.5GB Space. The full node RAM requirement has been growing about 8GB a month so you can adjust from there for your specs.

Offline JonnyB

  • Hero Member
  • *****
  • Posts: 636
    • View Profile
    • twitter.com/jonnybitcoin
you'll need a lot of ram, I think 32 gig is recommended. not sure of blockchain size
I run the @bitshares twitter handle
twitter.com/bitshares

Offline severo

  • Full Member
  • ***
  • Posts: 71
    • View Profile
Hello everyone. I would like to know the hardware requirements needed to build an efficient full BitShares node.

What size are all the blockchains of BitShares and what RAM is needed to load it efficiently?