Author Topic: Muse nodes suddenly not working  (Read 1099 times)

0 Members and 1 Guest are viewing this topic.

Offline Xeldal

  • Hero Member
  • *****
  • Posts: 1023
    • View Profile
  • BitShares: xeldal
Muse nodes suddenly not working
« on: January 26, 2016, 01:44:11 am »
I had 3 backup nodes all working fine.

On each one, I simply stopped and restarted with exactly the same parameters and now none of them will run, with or without production parameters.

Quote
:~/muse/programs/witness_node# ./witness_node --rpc-endpoint "127.0.0.1:9090" -s 54.165.143.33:5197
2446391ms th_a       witness.cpp:89                plugin_initialize    ] witness plugin:  plugin_initialize() begin
2446392ms th_a       witness.cpp:99                plugin_initialize    ] key_id_to_wif_pair: ["xxx","xxx"]
2446392ms th_a       witness.cpp:117               plugin_initialize    ] witness plugin:  plugin_initialize() end
2446393ms th_a       object_database.cpp:94        open                 ] Opening object database from /root/muse/programs/witness_node/witness_node_data_dir/blockchain ...
2446815ms th_a       object_database.cpp:100       open                 ] Done opening object database.
2446816ms th_a       db_management.cpp:128         open                 ] last_block->id(): 0028d7236f8bcb9e1a0a0b5daed28edeefd3d5e6 last_block->block_num(): 2676515
2446816ms th_a       db_management.cpp:136         open                 ] 10 assert_exception: Assert Exception
head_block_num() == 0: last block ID does not match current chain state
    {}
    th_a  db_management.cpp:131 open
2446816ms th_a       db_management.cpp:136         open                 ] data_dir: /root/muse/programs/witness_node/witness_node_data_dir/blockchain
2446816ms th_a       application.cpp:399           startup              ] 10 assert_exception: Assert Exception
head_block_num() == 0: last block ID does not match current chain state
    {}
    th_a  db_management.cpp:131 open
rethrow
    {"data_dir":"/root/muse/programs/witness_node/witness_node_data_dir/blockchain"}
    th_a  db_management.cpp:136 open
2446817ms th_a       application.cpp:944           startup              ] 10 assert_exception: Assert Exception
head_block_num() == 0: last block ID does not match current chain state
    {}
    th_a  db_management.cpp:131 open
rethrow
    {"data_dir":"/root/muse/programs/witness_node/witness_node_data_dir/blockchain"}
    th_a  db_management.cpp:136 open
rethrow
    {}
    th_a  application.cpp:399 startup
2446817ms th_a       main.cpp:195                  main                 ] Exiting with error:
10 assert_exception: Assert Exception
head_block_num() == 0: last block ID does not match current chain state
    {}
    th_a  db_management.cpp:131 open
rethrow
    {"data_dir":"/root/muse/programs/witness_node/witness_node_data_dir/blockchain"}
    th_a  db_management.cpp:136 open
rethrow
    {}
    th_a  application.cpp:399 startup

Quote
2732458ms th_a       db_management.cpp:99          reindex              ] Done reindexing, elapsed time: 38.92321700000000106 sec
2732472ms th_a       thread.cpp:95                 thread               ] name:ntp tid:140210011465472
2732473ms th_a       thread.cpp:95                 thread               ] name:p2p tid:140209994680064
2732495ms th_a       application.cpp:131           reset_p2p_node       ] Adding seed node 54.165.143.33:5197
2732496ms th_a       application.cpp:143           reset_p2p_node       ] Configured p2p node to listen on 0.0.0.0:60018
2732497ms th_a       application.cpp:193           reset_websocket_serv ] Configured websocket rpc to listen on 127.0.0.1:9090
2732497ms th_a       application.cpp:399           startup              ] 13 N11websocketpp9exceptionE: Underlying Transport Error
Underlying Transport Error:
    {"what":"Underlying Transport Error"}
    th_a  application.cpp:196 reset_websocket_server
2732497ms th_a       application.cpp:944           startup              ] 13 N11websocketpp9exceptionE: Underlying Transport Error
Underlying Transport Error:
    {"what":"Underlying Transport Error"}
    th_a  application.cpp:196 reset_websocket_server
rethrow
    {}
    th_a  application.cpp:399 startup
2732497ms th_a       main.cpp:195                  main                 ] Exiting with error:
13 N11websocketpp9exceptionE: Underlying Transport Error
Underlying Transport Error:
    {"what":"Underlying Transport Error"}
    th_a  application.cpp:196 reset_websocket_server
rethrow
    {}
    th_a  application.cpp:399 startup
2732532ms ntp        ntp.cpp:177                   read_loop            ] ntp_delta_time updated to 6546 us
2732564ms th_a       thread.cpp:115                ~thread              ] calling quit() on p2p
2732564ms th_a       thread.cpp:160                quit                 ] destroying boost thread 140209994680064
2732564ms p2p        thread.cpp:246                exec                 ] thread canceled: 9 canceled_exception: Canceled

    {}
    p2p  thread_d.hpp:461 start_next_fiber
« Last Edit: January 26, 2016, 01:46:18 am by Xeldal »

Offline roadscape

Re: Muse nodes suddenly not working
« Reply #1 on: January 26, 2016, 01:50:58 am »
Ah.. I just had the same issue with the main seed node:
https://bitsharestalk.org/index.php/topic,19524.msg274358.html#msg274358
http://cryptofresh.com  |  witness: roadscape

Offline Xeldal

  • Hero Member
  • *****
  • Posts: 1023
    • View Profile
  • BitShares: xeldal
Re: Muse nodes suddenly not working
« Reply #2 on: January 26, 2016, 01:54:10 am »
Ah.. I just had the same issue with the main seed node:
https://bitsharestalk.org/index.php/topic,19524.msg274358.html#msg274358

Thank you.  That did the trick. :)

Offline roadscape

Re: Muse nodes suddenly not working
« Reply #3 on: January 26, 2016, 02:02:11 am »
:)

Slightly related: can't seem to build the latest muse master.
Have you tried updating recently? Here's what I get, even on a fresh clone:

Code: [Select]
CMake Error at libraries/chain/CMakeLists.txt:30 (add_library):
  Cannot find source file:

    include/graphene/chain/hardfork.hpp

  Tried extensions .c .C .c++ .cc .cpp .cxx .m .M .mm .h .hh .h++ .hm .hpp
  .hxx .in .txx

Where to report this..I suppose the graphene repo, since the muse fork doesn't appear to have 'Issues' enabled?
http://cryptofresh.com  |  witness: roadscape

Offline Xeldal

  • Hero Member
  • *****
  • Posts: 1023
    • View Profile
  • BitShares: xeldal
Re: Muse nodes suddenly not working
« Reply #4 on: January 26, 2016, 02:06:08 am »
Yeah, I just went through it.  Try this.

https://bitsharestalk.org/index.php/topic,21032.0.html

Offline roadscape

Re: Muse nodes suddenly not working
« Reply #5 on: January 26, 2016, 06:29:44 am »
Perfect, thanks!
http://cryptofresh.com  |  witness: roadscape