BitShares Forum

Main => General Discussion => Topic started by: bytemaster on December 12, 2014, 10:42:13 pm

Title: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: bytemaster on December 12, 2014, 10:42:13 pm
I just added a configuration parameter to disable all database indexes not required for chain validation.  When disabling these statistics databases I see significant improvement in reindexing AND most importantly I was able to reindex the entire chain using less than 500 MB of ram vs the 2GB+ that some people have been reporting.

https://github.com/BitShares/bitshares/commit/2a499e520b43a43ccd3cb458fad9a80caceef018

In the future delegates may want to run the optimized mode for performance reasons while block explorers and full nodes can do the extra indexing. 

中文翻译:
我刚刚加入了一项可以设置的参数， 可以用来禁止区块链验证所需以外所有的区块索引. 当这些统计资料库被禁止之后， 重新索引会有显着的改善， 同时内存只需占用500mb, 而不是过去某些人回报的的2gb以上.

https://github.com/BitShares/bitshares/commit/2a499e520b43a43ccd3cb458fad9a80caceef018

未来的受托人会希望以高效能模式执行程序， 而区块浏览器以及完整的节点可以做额外的索引.
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: xeroc on December 12, 2014, 10:59:36 pm
bam .. awesome!!
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: pollux on December 17, 2014, 08:05:46 pm
My standby delegate is getting pegged with DB reindexing on v 0.4.27.1. Is there an option to set or config to change to take advantage of limited indexing?
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: emski on December 17, 2014, 09:07:57 pm
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: bytemaster on December 17, 2014, 09:54:34 pm
Quote from: emski on December 17, 2014, 09:07:57 pm
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1

That particular option is actually broken by the temporary fix we put in place which relies up a previously optional database index. 
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: maqifrnswa on December 17, 2014, 10:27:43 pm
Quote from: pollux on December 17, 2014, 08:05:46 pm
My standby delegate is getting pegged with DB reindexing on v 0.4.27.1. Is there an option to set or config to change to take advantage of limited indexing?

it won't work in 0.4.27.1 (see BM's post above), but for the future the config is in ~/.BitShares/config.json
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: vikram on December 18, 2014, 12:06:09 am
Quote from: emski on December 17, 2014, 09:07:57 pm
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1

This option is still untested and could break wallets and/or block production.
Title: Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
Post by: kokojie on December 18, 2014, 03:15:28 am
What is this setting called?