Author [EN] [ZH] [ES] [PT] [IT] [DE] [FR] [NL] [TR] [SR] [AR] [RU] [EN] [ZH] [ES] [PT] [IT] [DE] [FR] [NL] [TR] [SR] [AR] [RU] [EN] [ZH] [ES] [PT] [IT] [DE] [FR] [NL] [TR] [SR] [AR] [RU] Topic: Update to Accelerate Reindexing Coming and Reduce Memory Requirement  (Read 563 times)

Offline bytemaster


I just added a configuration parameter to disable all database indexes not required for chain validation.  When disabling these statistics databases I see significant improvement in reindexing AND most importantly I was able to reindex the entire chain using less than 500 MB of ram vs the 2GB+ that some people have been reporting.

https://github.com/BitShares/bitshares/commit/2a499e520b43a43ccd3cb458fad9a80caceef018

In the future delegates may want to run the optimized mode for performance reasons while block explorers and full nodes can do the extra indexing. 

中文翻译:
我刚刚加入了一项可以设置的参数, 可以用来禁止区块链验证所需以外所有的区块索引. 当这些统计资料库被禁止之后, 重新索引会有显着的改善, 同时内存只需占用500mb, 而不是过去某些人回报的的2gb以上.

https://github.com/BitShares/bitshares/commit/2a499e520b43a43ccd3cb458fad9a80caceef018

未来的受托人会希望以高效能模式执行程序, 而区块浏览器以及完整的节点可以做额外的索引.
« Last Edit: December 18, 2014, 02:53:04 AM by cn-members »
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 11962
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BTS: xeroc
  • GitHub: xeroc
Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #1 on: December 12, 2014, 10:59:36 PM »
bam .. awesome!!
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

pollux

  • Guest
Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #2 on: December 17, 2014, 08:05:46 PM »
My standby delegate is getting pegged with DB reindexing on v 0.4.27.1. Is there an option to set or config to change to take advantage of limited indexing?

Offline emski

  • Hero Member
  • *****
  • Posts: 1283
    • View Profile
    • http://lnkd.in/nPbhxG
Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #3 on: December 17, 2014, 09:07:57 PM »
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1

Offline bytemaster

Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #4 on: December 17, 2014, 09:54:34 PM »
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1

That particular option is actually broken by the temporary fix we put in place which relies up a previously optional database index. 
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline maqifrnswa

  • Hero Member
  • *****
  • Posts: 661
    • View Profile
Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #5 on: December 17, 2014, 10:27:43 PM »
My standby delegate is getting pegged with DB reindexing on v 0.4.27.1. Is there an option to set or config to change to take advantage of limited indexing?

it won't work in 0.4.27.1 (see BM's post above), but for the future the config is in ~/.BitShares/config.json
maintains an Ubuntu PPA: https://launchpad.net/~showard314/+archive/ubuntu/bitshares [15% delegate] wallet_account_set_approval maqifrnswa true [50% delegate] wallet_account_set_approval delegate1.maqifrnswa true

Offline vikram

Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #6 on: December 18, 2014, 12:06:09 AM »
My delegate doesn't attempt to sync with this option on.
It drops all connections.
0.4.27.1

This option is still untested and could break wallets and/or block production.

Offline kokojie

  • Sr. Member
  • ****
  • Posts: 286
    • View Profile
  • Witness: kokojie
  • Payrate: 3%
Re: Update to Accelerate Reindexing Coming and Reduce Memory Requirement
« Reply #7 on: December 18, 2014, 03:15:28 AM »
What is this setting called?

 

Google+