Author Topic: October 5 Test Network  (Read 56765 times)

0 Members and 1 Guest are viewing this topic.

Offline clayop

  • Hero Member
  • *****
  • Posts: 2033
    • View Profile
    • Bitshares Korea
  • BitShares: clayop
Re: October 5 Test Network
« Reply #315 on: October 07, 2015, 09:05:26 pm »
60 TPS / 20 min test will begin at 21:00 UTC

Add: CORE donation to 'clayop' is more than welcome :D

Oops.... made a mistake. The test will begin at 21:25 UTC. Sorry about that.

Thanks Thom!
Bitshares Korea - http://www.bitshares.kr
Vote for me and see Korean Bitshares community grows
delegate-clayop

Offline betax

  • Hero Member
  • *****
  • Posts: 808
    • View Profile
Re: October 5 Test Network
« Reply #316 on: October 07, 2015, 09:28:06 pm »
bitshares-argentina  can you please let me know if you have changed your software in any way because it appears your node is consistently producing blocks even though you are not in the set of active witnesses.

Everyone else, please update your witness to the latest master before block 58500  (about 4 hours).

Hi dan, I didn't change anything. Neither played with uncommon settings as far as I remember . 

Running from master branch with last commit db84a492b9a2cf290f92a3987b59c11808138d56

How can I help debugging?

Can you post your config file and command line arguments.

It seems to be the same issue with the time:

Code: [Select]
1272283ms th_a       db_block.cpp:189              _push_block          ] Failed to push new block:
10 assert_exception: Assert Exception
next_block.witness == scheduled_witness: Witness produced block at wrong time
    {"block witness":"1.6.37","scheduled":"1.6.39","slot_num":1}
    th_a  db_block.cpp:644 validate_block_header

    {"next_block.block_num()":62650}
    th_a  db_block.cpp:509 _apply_block
1272290ms th_a       application.cpp:425           handle_block         ] Error when pushing block:
10 assert_exception: Assert Exception
next_block.witness == scheduled_witness: Witness produced block at wrong time
    {"block witness":"1.6.37","scheduled":"1.6.39","slot_num":1}
    th_a  db_block.cpp:644 validate_block_header

    {"next_block.block_num()":62650}
    th_a  db_block.cpp:509 _apply_block

    {"new_block":{"previous":"0000f4b90fc8a15cc975aa571539d3e7f9053b6f","timestamp":"2015-10-07T21:21:12","witness":"1.6.37","transaction_merkle_root":"aa42913b2a226f9132200a3cb19aa076e3c0d7b4","extensions":[],"witness_signature":"20449d3e22302d92dd18f54cd2406de08678774e6648073db27409ea25bdcd4425561a3a7e75a484ee161eab4e02ba806147824747553537ed57c964af3261e330","transactions":[{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.285","feed":{"settlement_price":{"base":{"amount":3327214,"asset_id":"1.3.285"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":3327214,"asset_id":"1.3.285"}}},"extensions":[]}]],"extensions":[],"signatures":["1f3a600a648a94885229e3b4cc91a8f8ea3d6cb368f555bf52ba233a44e648e08170d12c36bca47097846b6cd334c69392bc15a2796d87b620172235bd5bff705c"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.218","feed":{"settlement_price":{"base":{"amount":21452528,"asset_id":"1.3.218"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":21452528,"asset_id":"1.3.218"}}},"extensions":[]}]],"extensions":[],"signatures":["1f7e6481ccef5712d331e5613cfa706e4f6821fffd58ab88a3b05a7c1d18b2bda80487e0b2007369d6c10eeb8453f07573717c7cf15f3e5b4d17db45c6347cc49e"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.536","feed":{"settlement_price":{"base":{"amount":523393,"asset_id":"1.3.536"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":523393,"asset_id":"1.3.536"}}},"extensions":[]}]],"extensions":[],"signatures":["203cb740ed1f1706d0f0e0b273234fb3902ef987a28271d3005d613a3e9582075a4f1f2010d7ef27af1e2dbc2e78ecded4a66d1f5afb110333fc83eb84b52bccb3"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.330","feed":{"settlement_price":{"base":{"amount":465809,"asset_id":"1.3.330"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":465809,"asset_id":"1.3.330"}}},"extensions":[]}]],"extensions":[],"signatures":["1f0e44bd90670d6d35ad25202d54ec45968422d6315db6eb611c785f6dbc9c239d03b1da1049e9f429fce90e6ba6cc3c0e034e2803b04dd76ab72b3d53ad872082"],"operation_results":[[0,{}]]}]}}
    th_a  db_block.cpp:195 _push_block

plus, mine seem to needed a wipe and resync of the database...
https://metaexchange.info | Bitcoin<->Altcoin exchange | Instant | Safe | Low spreads

Offline betax

  • Hero Member
  • *****
  • Posts: 808
    • View Profile
Re: October 5 Test Network
« Reply #317 on: October 07, 2015, 09:38:43 pm »
It seems that the stress testing is being handled by the witnesses, it is just the UI that has some random freezes.
https://metaexchange.info | Bitcoin<->Altcoin exchange | Instant | Safe | Low spreads

Offline clayop

  • Hero Member
  • *****
  • Posts: 2033
    • View Profile
    • Bitshares Korea
  • BitShares: clayop
Re: October 5 Test Network
« Reply #318 on: October 07, 2015, 09:41:25 pm »
During the stress test, all inits are forked. Are they on the same machine?
Bitshares Korea - http://www.bitshares.kr
Vote for me and see Korean Bitshares community grows
delegate-clayop

Offline liondani

  • Hero Member
  • *****
  • Posts: 3737
  • Inch by inch, play by play
    • View Profile
    • My detailed info
  • BitShares: liondani
  • GitHub: liondani
Re: October 5 Test Network
« Reply #319 on: October 07, 2015, 09:43:23 pm »
During the stress test, all inits are forked. Are they on the same machine?

as bytemaster mentioned yesterday, yes.

Offline clayop

  • Hero Member
  • *****
  • Posts: 2033
    • View Profile
    • Bitshares Korea
  • BitShares: clayop
Re: October 5 Test Network
« Reply #320 on: October 07, 2015, 09:44:27 pm »
During the stress test, all inits are forked. Are they on the same machine?

as bytemaster mentioned yesterday, yes.

They shouldn't be on the real net  :(
Bitshares Korea - http://www.bitshares.kr
Vote for me and see Korean Bitshares community grows
delegate-clayop

Offline ElMato

  • Sr. Member
  • ****
  • Posts: 288
    • View Profile
Re: October 5 Test Network
« Reply #321 on: October 07, 2015, 09:47:57 pm »
60 TPS / 20 min test will begin at 21:00 UTC

Add: CORE donation to 'clayop' is more than welcome :D
20000 CORE sent

Offline Bhuz

  • Committee member
  • Sr. Member
  • *
  • Posts: 467
    • View Profile
  • BitShares: bhuz
Re: October 5 Test Network
« Reply #322 on: October 07, 2015, 09:48:59 pm »
During the stress test, all inits are forked. Are they on the same machine?

as bytemaster mentioned yesterday, yes.

They shouldn't be on the real net  :(

Let's see if they manage to come back in as soon as the stress ends :)

Offline betax

  • Hero Member
  • *****
  • Posts: 808
    • View Profile
Re: October 5 Test Network
« Reply #323 on: October 07, 2015, 09:55:33 pm »
is the web sockeds backed tcp loadbalanced? how many backend servers are used? To avoid the freezing, if an issue with the backed.

If it is an issue with the frontend can we delay response to the ui, or is it already throtle based on the tps / current screen.

Also I seemed to need to refresh the browser a couple of times to get the latest block whilst doing the load test.
« Last Edit: October 07, 2015, 10:06:14 pm by betax »
https://metaexchange.info | Bitcoin<->Altcoin exchange | Instant | Safe | Low spreads

Offline clayop

  • Hero Member
  • *****
  • Posts: 2033
    • View Profile
    • Bitshares Korea
  • BitShares: clayop
Re: October 5 Test Network
« Reply #324 on: October 07, 2015, 09:58:03 pm »
During the stress test, all inits are forked. Are they on the same machine?

as bytemaster mentioned yesterday, yes.

They shouldn't be on the real net  :(

Let's see if they manage to come back in as soon as the stress ends :)

Wow the network is really resilient. They are coming back.
Bitshares Korea - http://www.bitshares.kr
Vote for me and see Korean Bitshares community grows
delegate-clayop

Offline bytemaster

Re: October 5 Test Network
« Reply #325 on: October 07, 2015, 10:10:58 pm »
Init witnesses forked because our whole office lost internet connection and not because of the flooding.


That said, they did come back on their own.   Yes they are all on one machine.
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline bytemaster

Re: October 5 Test Network
« Reply #326 on: October 07, 2015, 10:13:47 pm »
is the web sockeds backed tcp loadbalanced? how many backend servers are used? To avoid the freezing, if an issue with the backed.

If it is an issue with the frontend can we delay response to the ui, or is it already throtle based on the tps / current screen.

Also I seemed to need to refresh the browser a couple of times to get the latest block whilst doing the load test.

Currently the backend pushes ALL state changes to the GUI whether or not the GUI cares about that particular state.   This was a shortcut taken to maximize reliability of the front end receiving updates.  We already have the filters in place to throttle this back to only the data the GUI has previously requested.   

So the GUI infrastructure is not well suited for these flood tests, but is well suited to serving 1000+ simultaneous users at normal transaction volumes.
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline bytemaster

Re: October 5 Test Network
« Reply #327 on: October 07, 2015, 10:16:38 pm »
bitshares-argentina  can you please let me know if you have changed your software in any way because it appears your node is consistently producing blocks even though you are not in the set of active witnesses.

Everyone else, please update your witness to the latest master before block 58500  (about 4 hours).

Hi dan, I didn't change anything. Neither played with uncommon settings as far as I remember . 

Running from master branch with last commit db84a492b9a2cf290f92a3987b59c11808138d56

How can I help debugging?

Can you post your config file and command line arguments.

It seems to be the same issue with the time:

Code: [Select]
1272283ms th_a       db_block.cpp:189              _push_block          ] Failed to push new block:
10 assert_exception: Assert Exception
next_block.witness == scheduled_witness: Witness produced block at wrong time
    {"block witness":"1.6.37","scheduled":"1.6.39","slot_num":1}
    th_a  db_block.cpp:644 validate_block_header

    {"next_block.block_num()":62650}
    th_a  db_block.cpp:509 _apply_block
1272290ms th_a       application.cpp:425           handle_block         ] Error when pushing block:
10 assert_exception: Assert Exception
next_block.witness == scheduled_witness: Witness produced block at wrong time
    {"block witness":"1.6.37","scheduled":"1.6.39","slot_num":1}
    th_a  db_block.cpp:644 validate_block_header

    {"next_block.block_num()":62650}
    th_a  db_block.cpp:509 _apply_block

    {"new_block":{"previous":"0000f4b90fc8a15cc975aa571539d3e7f9053b6f","timestamp":"2015-10-07T21:21:12","witness":"1.6.37","transaction_merkle_root":"aa42913b2a226f9132200a3cb19aa076e3c0d7b4","extensions":[],"witness_signature":"20449d3e22302d92dd18f54cd2406de08678774e6648073db27409ea25bdcd4425561a3a7e75a484ee161eab4e02ba806147824747553537ed57c964af3261e330","transactions":[{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.285","feed":{"settlement_price":{"base":{"amount":3327214,"asset_id":"1.3.285"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":3327214,"asset_id":"1.3.285"}}},"extensions":[]}]],"extensions":[],"signatures":["1f3a600a648a94885229e3b4cc91a8f8ea3d6cb368f555bf52ba233a44e648e08170d12c36bca47097846b6cd334c69392bc15a2796d87b620172235bd5bff705c"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.218","feed":{"settlement_price":{"base":{"amount":21452528,"asset_id":"1.3.218"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":21452528,"asset_id":"1.3.218"}}},"extensions":[]}]],"extensions":[],"signatures":["1f7e6481ccef5712d331e5613cfa706e4f6821fffd58ab88a3b05a7c1d18b2bda80487e0b2007369d6c10eeb8453f07573717c7cf15f3e5b4d17db45c6347cc49e"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.536","feed":{"settlement_price":{"base":{"amount":523393,"asset_id":"1.3.536"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":523393,"asset_id":"1.3.536"}}},"extensions":[]}]],"extensions":[],"signatures":["203cb740ed1f1706d0f0e0b273234fb3902ef987a28271d3005d613a3e9582075a4f1f2010d7ef27af1e2dbc2e78ecded4a66d1f5afb110333fc83eb84b52bccb3"],"operation_results":[[0,{}]]},{"ref_block_num":62648,"ref_block_prefix":1109897537,"expiration":"2015-10-07T21:21:36","operations":[[19,{"fee":{"amount":100000,"asset_id":"1.3.0"},"publisher":"1.2.67704","asset_id":"1.3.330","feed":{"settlement_price":{"base":{"amount":465809,"asset_id":"1.3.330"},"quote":{"amount":1000000000,"asset_id":"1.3.0"}},"maintenance_collateral_ratio":1750,"maximum_short_squeeze_ratio":1500,"core_exchange_rate":{"base":{"amount":1000000000,"asset_id":"1.3.0"},"quote":{"amount":465809,"asset_id":"1.3.330"}}},"extensions":[]}]],"extensions":[],"signatures":["1f0e44bd90670d6d35ad25202d54ec45968422d6315db6eb611c785f6dbc9c239d03b1da1049e9f429fce90e6ba6cc3c0e034e2803b04dd76ab72b3d53ad872082"],"operation_results":[[0,{}]]}]}}
    th_a  db_block.cpp:195 _push_block

plus, mine seem to needed a wipe and resync of the database...


If you see this again, can you post the block number and output of

Code: [Select]
get_object 2.12.0
It will let me know if your witness has a different shuffling.
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline betax

  • Hero Member
  • *****
  • Posts: 808
    • View Profile
Re: October 5 Test Network
« Reply #328 on: October 07, 2015, 10:21:02 pm »
is the web sockeds backed tcp loadbalanced? how many backend servers are used? To avoid the freezing, if an issue with the backed.

If it is an issue with the frontend can we delay response to the ui, or is it already throtle based on the tps / current screen.

Also I seemed to need to refresh the browser a couple of times to get the latest block whilst doing the load test.

Currently the backend pushes ALL state changes to the GUI whether or not the GUI cares about that particular state.   This was a shortcut taken to maximize reliability of the front end receiving updates.  We already have the filters in place to throttle this back to only the data the GUI has previously requested.   

So the GUI infrastructure is not well suited for these flood tests, but is well suited to serving 1000+ simultaneous users at normal transaction volumes.

 +5% very nice. Prioritization of requirements but well thought out architecture. Also now the client is not a major issue, being a web wallet you can do continuous releases.
https://metaexchange.info | Bitcoin<->Altcoin exchange | Instant | Safe | Low spreads

Offline Bhuz

  • Committee member
  • Sr. Member
  • *
  • Posts: 467
    • View Profile
  • BitShares: bhuz
Re: October 5 Test Network
« Reply #329 on: October 07, 2015, 10:23:23 pm »
I keep getting these:

Code: [Select]
1320597ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0000f7e5f7f08e5cb01d5de1cee93e005447e29d, 63461
1320597ms th_a       fork_database.cpp:58          push_block           ] Head: 63390, 0000f79e741dd849af4e69a62a425f11497ce433
1320606ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0000f7e4de13bc0878fd684d7cf434a9f527dfde","timestamp":"2015-10-07T22:14:06","witness":"1.6.30","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f5046c64faf845e027e25ae05ef6b4837f22587e8d06bca11204b559679c14de45e96852d50123d04f1e062f61e8ae3e5276c73cd2f591e2ebfdcf75a790d20b8","transactions":[]}}
    th_a  db_block.cpp:197 _push_block
1320607ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0000f7e63816b8b72183f76d418d9be0c778fb91, 63462
1320607ms th_a       fork_database.cpp:58          push_block           ] Head: 63390, 0000f79e741dd849af4e69a62a425f11497ce433
1320617ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0000f7e5f7f08e5cb01d5de1cee93e005447e29d","timestamp":"2015-10-07T22:14:09","witness":"1.6.8","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"2032e0250f672b893e51a18748d6f4c58dda8b5beea2bd9c7af09d48bfc0e47a294a02cc2920410654cef00dddb3cbd0067c450f015ff5b9657d069a890db5b364","transactions":[]}}
    th_a  db_block.cpp:197 _push_block
1320619ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0000f7e737562f094e061a43446ad6958b2d681b, 63463
1320619ms th_a       fork_database.cpp:58          push_block           ] Head: 63390, 0000f79e741dd849af4e69a62a425f11497ce433
1320632ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0000f7e63816b8b72183f76d418d9be0c778fb91","timestamp":"2015-10-07T22:14:15","witness":"1.6.35","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"20151fdaf0786206e717d917f30e4d7b46d27035dc812e65056448dbac7e80daab309b85b0102f726c514263084df83c42392f46fcfc31937b88d28b2b7f2b58a5","transactions":[]}}
    th_a  db_block.cpp:197 _push_block
1320634ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0000f7e86ed61243a7d820d3710862966c099480, 63464
1320634ms th_a       fork_database.cpp:58          push_block           ] Head: 63390, 0000f79e741dd849af4e69a62a425f11497ce433
1320648ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0000f7e737562f094e061a43446ad6958b2d681b","timestamp":"2015-10-07T22:14:18","witness":"1.6.24","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f6abbde2d9f9cfc8d61647e72864ea497faa2ca2fded3a9036ee2be6e9f4b2183724e420fe74258142e054779e5f68405d796f987929c5d14f810d44f8821fecb","transactions":[]}}
    th_a  db_block.cpp:197 _push_block
1320649ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0000f7e9e20d7289c66b4b132c6ccfbbec011865, 63465
1320649ms th_a       fork_database.cpp:58          push_block           ] Head: 63390, 0000f79e741dd849af4e69a62a425f11497ce433
1320663ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0000f7e86ed61243a7d820d3710862966c099480","timestamp":"2015-10-07T22:14:27","witness":"1.6.29","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f0a88ac998c931c9622175c6824636307f2fea2866bc13670bac2242ceaf85abd64328132fc7ec5bfb5b189af8745722b37f3ff16b197eaa9a81b4411c9c3006e","transactions":[]}}
    th_a  db_block.cpp:197 _push_block

Code: [Select]
info
{
  "head_block_num": 63389,
  "head_block_id": "0000f79d286062943a634c0fc401d4204fa2187b",
  "head_block_age": "17 minutes old",
  "next_maintenance_time": "35 minutes in the future",
  "chain_id": "60e21871125ea9995fe498b7f68a87a85c6583725ea5448f6fd969c59a37df83",
  "participation": "93.75000000000000000",
« Last Edit: October 07, 2015, 10:27:16 pm by Bhuz »