Author Topic: Test Net for Advanced Users  (Read 118013 times)

0 Members and 1 Guest are viewing this topic.

Offline spartako

  • Sr. Member
  • ****
  • Posts: 401
    • View Profile
Re: Test Net for Advanced Users
« Reply #1320 on: September 30, 2015, 08:40:42 am »
I am no more able to run my witness, every time I get this error:

Code: [Select]
witness_node: /home/spartako/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
Aborted (core dumped)


Also https://graphene.bitshares.org/ seems down
wallet_account_set_approval spartako

Offline clayop

  • Hero Member
  • *****
  • Posts: 2033
    • View Profile
    • Bitshares Korea
  • BitShares: clayop
Re: Test Net for Advanced Users
« Reply #1321 on: September 30, 2015, 08:49:56 am »
It seems that the network has some serious problem. My cli_client says that the head block age is 30 min old.
Bitshares Korea - http://www.bitshares.kr
Vote for me and see Korean Bitshares community grows
delegate-clayop

Offline CalabiYau

Re: Test Net for Advanced Users
« Reply #1322 on: September 30, 2015, 09:22:14 am »
calabiyau updated
Code: [Select]
witness_node: /home/calabiyau/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
Aborted (core dumped)

seems to sync now after rm blockchain again

uumm - no:
Code: [Select]
witness_node: /home/calabiyau/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
Aborted (core dumped)



Offline Riverhead

Re: Test Net for Advanced Users
« Reply #1323 on: September 30, 2015, 09:49:20 am »
Ditto. I'll restart in gdb.

Code: [Select]
witness_node: /home/riverhead/github/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
Aborted

Offline wackou

Re: Test Net for Advanced Users
« Reply #1324 on: September 30, 2015, 10:18:13 am »
had this crash too:

Code: [Select]
1294000ms th_a       witness.cpp:182               block_production_loo ] Not producing block because it isn't my turn
1295000ms th_a       witness.cpp:182               block_production_loo ] Not producing block because it isn't my turn
witness_node: /home/admin/.BitShares2_build/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.

Program received signal SIGABRT, Aborted.
0x00007ffff6516107 in raise () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) bt
#0  0x00007ffff6516107 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007ffff65174e8 in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2  0x00007ffff650f226 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3  0x00007ffff650f2d2 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
#4  0x00000000024ec8a3 in graphene::chain::database::fill_order (this=0x360f160, order=..., pays=..., receives=...)
    at /home/admin/.BitShares2_build/libraries/chain/db_market.cpp:290
#5  0x00000000024ec173 in graphene::chain::database::match (this=0x360f160, call=..., settle=..., match_price=..., max_settlement=...)
    at /home/admin/.BitShares2_build/libraries/chain/db_market.cpp:239
#6  0x00000000024f1f82 in graphene::chain::database::clear_expired_orders (this=0x360f160) at /home/admin/.BitShares2_build/libraries/chain/db_update.cpp:237
#7  0x00000000024d4b90 in graphene::chain::database::_apply_block (this=0x360f160, next_block=...)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:478
#8  0x00000000024d4088 in graphene::chain::database::<lambda()>::operator()(void) const (__closure=0x7fffe7df1330)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:436
#9  0x00000000024f2f55 in graphene::chain::detail::with_skip_flags<graphene::chain::database::apply_block(const graphene::chain::signed_block&, uint32_t)::<lambda()> >(graphene::chain::database &, uint32_t, graphene::chain::database::<lambda()>) (db=..., skip_flags=0, callback=...)
    at /home/admin/.BitShares2_build/libraries/chain/include/graphene/chain/db_with.hpp:123
#10 0x00000000024d44ad in graphene::chain::database::apply_block (this=0x360f160, next_block=..., skip=0)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:437
#11 0x00000000024ce648 in graphene::chain::database::_push_block (this=0x360f160, new_block=...)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:185
#12 0x00000000024cdc21 in graphene::chain::database::<lambda()>::<lambda()>::operator()(void) const (__closure=0x7fffe7df1e20)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:112
#13 0x00000000024f2d5e in graphene::chain::detail::without_pending_transactions<graphene::chain::database::push_block(const graphene::chain::signed_block&, uint32_t)::<lambda()>::<lambda()> >(graphene::chain::database &, <unknown type in /home/admin/.BitShares2_bin/witness_node_2015-09-24_test3c-1-gd01fc0a, CU 0xfa3feb, DIE 0x11f4221>, graphene::chain::database::<lambda()>::<lambda()>) (db=...,
    pending_transactions=<unknown type in /home/admin/.BitShares2_bin/witness_node_2015-09-24_test3c-1-gd01fc0a, CU 0xfa3feb, DIE 0x11f4221>, callback=...)
    at /home/admin/.BitShares2_build/libraries/chain/include/graphene/chain/db_with.hpp:140
#14 0x00000000024cdc92 in graphene::chain::database::<lambda()>::operator()(void) const (__closure=0x7fffe7df1ed0)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:113
#15 0x00000000024f2dd9 in graphene::chain::detail::with_skip_flags<graphene::chain::database::push_block(const graphene::chain::signed_block&, uint32_t)::<lambda()> >(graphene::chain::database &, uint32_t, graphene::chain::database::<lambda()>) (db=..., skip_flags=0, callback=...)
    at /home/admin/.BitShares2_build/libraries/chain/include/graphene/chain/db_with.hpp:123
#16 0x00000000024cdce3 in graphene::chain::database::push_block (this=0x360f160, new_block=..., skip=0)
    at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:114
---Type <return> to continue, or q <return> to quit---
#17 0x00000000024d158b in graphene::chain::database::_generate_block (this=0x360f160, when=..., witness_id=..., block_signing_private_key=..., retry_on_failure=true) at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:368
#18 0x00000000024d07d3 in graphene::chain::database::<lambda()>::operator()(void) const (__closure=0x7fffe7df2c40) at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:276
#19 0x00000000024f2ecf in graphene::chain::detail::with_skip_flags<graphene::chain::database::generate_block(fc::time_point_sec, graphene::chain::witness_id_type, const fc::ecc::private_key&, uint32_t)::<lambda()> >(graphene::chain::database &, uint32_t, graphene::chain::database::<lambda()>) (db=..., skip_flags=0, callback=...) at /home/admin/.BitShares2_build/libraries/chain/include/graphene/chain/db_with.hpp:123
#20 0x00000000024d089f in graphene::chain::database::generate_block (this=0x360f160, when=..., witness_id=..., block_signing_private_key=..., skip=0) at /home/admin/.BitShares2_build/libraries/chain/db_block.cpp:277
#21 0x00000000024c218f in graphene::witness_plugin::witness_plugin::maybe_produce_block (this=0x3618410, capture=...) at /home/admin/.BitShares2_build/libraries/plugins/witness/witness.cpp:276
#22 0x00000000024bff51 in graphene::witness_plugin::witness_plugin::block_production_loop (this=0x3618410) at /home/admin/.BitShares2_build/libraries/plugins/witness/witness.cpp:160
#23 0x00000000024bfe19 in graphene::witness_plugin::witness_plugin::<lambda()>::operator()(void) const (__closure=0x1639d188) at /home/admin/.BitShares2_build/libraries/plugins/witness/witness.cpp:150
#24 0x00000000024c3288 in fc::detail::void_functor_run<graphene::witness_plugin::witness_plugin::schedule_production_loop()::<lambda()> >::run(void *, void *) (functor=0x1639d188, prom=0x1639d180)
    at /home/admin/.BitShares2_build/libraries/fc/include/fc/thread/task.hpp:83
#25 0x00000000027e209d in fc::task_base::run_impl (this=0x1639d190) at /home/admin/.BitShares2_build/libraries/fc/src/thread/task.cpp:43
#26 0x00000000027e202c in fc::task_base::run (this=0x1639d190) at /home/admin/.BitShares2_build/libraries/fc/src/thread/task.cpp:32
#27 0x00000000027d608a in fc::thread_d::run_next_task (this=0x364d2f0) at /home/admin/.BitShares2_build/libraries/fc/src/thread/thread_d.hpp:498
#28 0x00000000027d6554 in fc::thread_d::process_tasks (this=0x364d2f0) at /home/admin/.BitShares2_build/libraries/fc/src/thread/thread_d.hpp:547
#29 0x00000000027d5b7e in fc::thread_d::start_process_tasks (my=56939248) at /home/admin/.BitShares2_build/libraries/fc/src/thread/thread_d.hpp:475
#30 0x0000000002b50711 in make_fcontext ()
#31 0x00010102464c457f in ?? ()
#32 0x0000000000000000 in ?? ()
(gdb)

Note that I hadn't upgraded to the latest master yet, will do so now.
Please vote for witness wackou! More info at http://digitalgaia.io

Offline wackou

Re: Test Net for Advanced Users
« Reply #1325 on: September 30, 2015, 10:25:25 am »
not sure if that's helpful, but I tried to get some more info out of it, and I could retrieve this:

the block in push_block (in stack frame #16) has a header that starts like this:

Code: [Select]
{<graphene::chain::block_header> = {previous = {_hash = {3201106944, 1397224070, 591270816, 3178160838, 2663318844}}, timestamp = {utc_seconds = 1443601296} [...]
Please vote for witness wackou! More info at http://digitalgaia.io

iHashFury

  • Guest
Re: Test Net for Advanced Users
« Reply #1326 on: September 30, 2015, 11:01:25 am »
Crashed on witness and one of my nodes at the same block

# witness crash
Code: [Select]
1244000ms th_a       witness.cpp:182               block_production_loo ] Not producing block because it isn't my turn
witness_node: /home/ihashfury/tmp/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene:
:chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' fa
iled.
Aborted (core dumped)

# node crash
Code: [Select]
1272262ms th_a       application.cpp:388           handle_block         ] Got block #314815 with time 2015-09-30T08:21:12 from network with latency of 263 ms from init0
witness_node: /home/ihashfury/tmp/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
Aborted

Offline bytemaster

Re: Test Net for Advanced Users
« Reply #1327 on: September 30, 2015, 12:17:14 pm »
I wake up this morning and my witness for all night was not able to sync the correct fork.
I have a while [ True ] in my bash script so if it crash, it start again but every times gives me this error and started again to try to resync (without success):

Code: [Select]
   93.3428%   284000 of 304255
1818515ms th_a       undo_database.hpp:62          ~session             ] 10 assert_exception: Assert Exception
!_disabled:
    {}
    th_a  undo_database.cpp:88 undo

    {}
    th_a  undo_database.cpp:116 undo
terminate called after throwing an instance of 'fc::assert_exception'
Aborted (core dumped)

Now the  witness if updated to the new master.

This issue was fixed yesterday. 
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline Fox

Re: Test Net for Advanced Users
« Reply #1328 on: September 30, 2015, 12:22:22 pm »
All of my updated nodes also crashed.  I am now unable to --resync-blockchain.  I only have a single seed node listed in my startup script, but it is not responding. 

Please post your peers so that I may sync.
Witness: fox

Offline bytemaster

Re: Test Net for Advanced Users
« Reply #1329 on: September 30, 2015, 12:27:41 pm »
All of my nodes were hung when I came in this morning.  Looks like a major issue was discovered and we are looking into the cause. 

Based upon the crash reports it looks like someone attempted a force settle. 
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline bytemaster

Re: Test Net for Advanced Users
« Reply #1330 on: September 30, 2015, 12:28:49 pm »
All of my updated nodes also crashed.  I am now unable to --resync-blockchain.  I only have a single seed node listed in my startup script, but it is not responding. 

Please post your peers so that I may sync.

The network is effectively dead at this point.  It will require a checkpoint to revive.   

Could everyone post their head block number and hash?
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline bytemaster

Re: Test Net for Advanced Users
« Reply #1331 on: September 30, 2015, 12:29:20 pm »
  "head_block_num": 314836,
  "head_block_id": "0004cdd471f6d83da5ddcfc8d93b65262538643a",
  "head_block_age": "4 hours old"
For the latest updates checkout my blog: http://bytemaster.bitshares.org
Anything said on these forums does not constitute an intent to create a legal obligation or contract between myself and anyone else.   These are merely my opinions and I reserve the right to change them at any time.

Offline Riverhead

Re: Test Net for Advanced Users
« Reply #1332 on: September 30, 2015, 12:37:19 pm »

No useful info here I'm afraid. I tried to reload with a new chain but the network was already dead.

Code: [Select]
  "head_block_num": 0,
  "head_block_id": "0000000000000000000000000000000000000000",
  "head_block_age": "12 days old",
  "next_maintenance_time": "45 years ago",
  "chain_id": "0f8b631d7a9dfebf16d6776fab96b629a14429762bf9c3eb95db1e4e4af637a4",
  "participation": "100.00000000000000000",


Xeldal

  • Guest
Re: Test Net for Advanced Users
« Reply #1333 on: September 30, 2015, 12:40:23 pm »
"head_block_num": 314814,
  "head_block_id": "0004cdbe86f24753a0133e23c6e26ebd3c05bf9e",
  "head_block_age": "4 hours old",

Offline Troglodactyl

  • Hero Member
  • *****
  • Posts: 960
    • View Profile
Re: Test Net for Advanced Users
« Reply #1334 on: September 30, 2015, 12:42:38 pm »
Here's how my observer node ended:

Code: [Select]
1179254ms th_a       application.cpp:388           handle_block         ] Got block #314806 with time 2015-09-30T08:19:39 from network with latency of 255 ms from delegate-dev3.btsnow
1179486ms th_a       application.cpp:518           get_item             ] Serving up block #314806
1182227ms th_a       application.cpp:388           handle_block         ] Got block #314807 with time 2015-09-30T08:19:42 from network with latency of 227 ms from init6
1182462ms th_a       application.cpp:518           get_item             ] Serving up block #314807
1185107ms th_a       application.cpp:388           handle_block         ] Got block #314808 with time 2015-09-30T08:19:45 from network with latency of 108 ms from init11
1185338ms th_a       application.cpp:518           get_item             ] Serving up block #314808
1188176ms th_a       application.cpp:388           handle_block         ] Got block #314809 with time 2015-09-30T08:19:48 from network with latency of 177 ms from init1
1188411ms th_a       application.cpp:518           get_item             ] Serving up block #314809
1191249ms th_a       application.cpp:388           handle_block         ] Got block #314810 with time 2015-09-30T08:19:51 from network with latency of 250 ms from init2
1194378ms th_a       application.cpp:388           handle_block         ] Got block #314811 with time 2015-09-30T08:19:54 from network with latency of 379 ms from delegate-clayop
1197207ms th_a       application.cpp:388           handle_block         ] Got block #314812 with time 2015-09-30T08:19:57 from network with latency of 207 ms from wackou
1200221ms th_a       application.cpp:388           handle_block         ] Got block #314813 with time 2015-09-30T08:20:00 from network with latency of 222 ms from init4
1200461ms th_a       application.cpp:518           get_item             ] Serving up block #314813
1203250ms th_a       application.cpp:388           handle_block         ] Got block #314814 with time 2015-09-30T08:20:03 from network with latency of 251 ms from init3
1207182ms th_a       application.cpp:388           handle_block         ] Got block #314814 with time 2015-09-30T08:20:06 from network with latency of 1182 ms from mr.agsexplorer
2209930ms th_a       application.cpp:699           get_blockchain_synop ] synopsis: ["0004cdb3d2d7eb80189f83633c4cb9edfa428ca8","0004cdb90bdf86f48dd2d6695fe8f5edb3322e67","0004cdbcecb0901e9e26dabd0c5610f648a14108","0004cdbe86f24753a0133e23c6e26ebd3c05bf9e"]
...
Code: [Select]
890491ms th_a       application.cpp:518           get_item             ] Serving up block #314811
890491ms th_a       application.cpp:518           get_item             ] Serving up block #314812
890491ms th_a       application.cpp:518           get_item             ] Serving up block #314813
890491ms th_a       application.cpp:518           get_item             ] Serving up block #314814
898941ms th_a       application.cpp:699           get_blockchain_synop ] synopsis: ["0004cdb4a094bb65e4ddf13138fca35a9c5b4141","0004cdbab1c582f8ccc1e6396f0d62cb9c047323","0004cdbde932bd1fbe5e160b4dd22b1a9b1f8135","0004cdbe86f24753a0133e23c6e26ebd3c05bf9e"]
witness_node: /home/daniel/Crypto/graphene/libraries/chain/db_market.cpp:290: bool graphene::chain::database::fill_order(const graphene::chain::call_order_object&, const graphene::chain::asset&, const graphene::chain::asset&): Assertion `order.get_collateral() >= pays' failed.
./run_node: line 1:  1063 Aborted                 (core dumped)

EDIT: The synopsis is just the last 4 blocks, right?
« Last Edit: September 30, 2015, 12:45:31 pm by Troglodactyl »