can't switch to correct chain, even restart witness_node(build from bfef440968e98219612a9bbd24e715e8835ad975),
get block 70872, but failed to push sync block
here is the error message from log file:

Code: [Select]

2015-10-08T06:31:23 p2p:send_sync_block_to_node_delegate send_sync_block_to_n ] Failed to push sync block 70872 (id:000114d879ab3c305edeaaae837c2b68b7da64d2): client   rejected sync block sent by peer: {"code":10,"name":"assert_exception","message":"Assert Exception","stack":[{"context":{"level":"error","file":"vesting_balance_evalu  ator.cpp","line":103,"method":"do_evaluate","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"vbo.is_withdraw_allowed( now, op.amount ):   ","data":{"now":"2015-10-08T05:43:09","op":{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"as  set_id":"1.3.0"}},"vbo":{"id":"1.13.60","owner":"1.2.8517","balance":{"amount":202500000,"asset_id":"1.3.0"},"policy":[1,{"vesting_seconds":86400,"start_claim":"1970-  01-01T00:00:00","coin_seconds_earned":"3290619000000","coin_seconds_earned_last_update":"2015-10-08T05:43:06"}]}}},{"context":{"level":"warn","file":"vesting_balance_  evaluator.cpp","line":109,"method":"do_evaluate","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{"op":{"fee":{"amount":10000  0,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}}},{"context":{"level":"warn","file":"evaluator.c  pp","line":42,"method":"start_evaluate","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{}},{"context":{"level":"warn","file"  :"db_block.cpp","line":625,"method":"apply_operation","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{}},{"context":{"level"  :"warn","file":"db_block.cpp","line":608,"method":"_apply_transaction","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{"trx"  :{"ref_block_num":5335,"ref_block_prefix":4159425851,"expiration":"2015-10-08T05:43:39","operations":[[33,{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance  ":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}]],"extensions":[],"signatures":["1f6f7ea6a4188c8fc36aaf457b5fe4433fb74af11b250507262a0  0d909af025ad065c03ef0f61925070489d1630a3fbe459795b265200544de9ba1694414fefbcf"]}}},{"context":{"level":"warn","file":"db_block.cpp","line":511,"method":"_apply_block"  ,"hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{"next_block.block_num()":70872}},{"context":{"level":"warn","file":"db_bloc  k.cpp","line":197,"method":"_push_block","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{"new_block":{"previous":"000114d73b  cdebf717450d1a45e7ea119844b22e","timestamp":"2015-10-08T05:43:15","witness":"1.6.10","transaction_merkle_root":"05b459df123ff6baf5dbc44890e6ae3e8a8caaf6","extensions"  :[],"witness_signature":"20232fc2bb2ead0cbc644d78e4462881dc812787ad28f1517229cc346c252acb2904cb13139a8e957c8087d8b03790f12f5c2ef0dbb2cfceead7a47521f75f0950","transact  ions":[{"ref_block_num":5335,"ref_block_prefix":4159425851,"expiration":"2015-10-08T05:43:39","operations":[[33,{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_b  alance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}]],"extensions":[],"signatures":["1f6f7ea6a4188c8fc36aaf457b5fe4433fb74af11b25050  7262a00d909af025ad065c03ef0f61925070489d1630a3fbe459795b265200544de9ba1694414fefbcf"],"operation_results":[[0,{}]]}]}}},{"context":{"level":"warn","file":"application  .cpp","line":434,"method":"handle_block","hostname":"","thread_name":"th_a","timestamp":"2015-10-08T06:31:23"},"format":"","data":{"blk_msg":{"block":{"previous":"000  114d73bcdebf717450d1a45e7ea119844b22e","timestamp":"2015-10-08T05:43:15","witness":"1.6.10","transaction_merkle_root":"05b459df123ff6baf5dbc44890e6ae3e8a8caaf6","exte  nsions":[],"witness_signature":"20232fc2bb2ead0cbc644d78e4462881dc812787ad28f1517229cc346c252acb2904cb13139a8e957c8087d8b03790f12f5c2ef0dbb2cfceead7a47521f75f0950","t  ransactions":[{"ref_block_num":5335,"ref_block_prefix":4159425851,"expiration":"2015-10-08T05:43:39","operations":[[33,{"fee":{"amount":100000,"asset_id":"1.3.0"},"ve  sting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}]],"extensions":[],"signatures":["1f6f7ea6a4188c8fc36aaf457b5fe4433fb74af1  1b250507262a00d909af025ad065c03ef0f61925070489d1630a3fbe459795b265200544de9ba1694414fefbcf"],"operation_results":[[0,{}]]}]},"block_id":"000114d879ab3c305edeaaae837c2  b68b7da64d2"},"sync_mode":true}}]}      node.cpp:3017                                                                                                                 

output from console

Code: [Select]

1883626ms th_a       db_block.cpp:191              _push_block          ] Failed to push new block:
10 assert_exception: Assert Exception
vbo.is_withdraw_allowed( now, op.amount ):
    {"now":"2015-10-08T05:43:09","op":{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":
"1.3.0"}},"vbo":{"id":"1.13.60","owner":"1.2.8517","balance":{"amount":202500000,"asset_id":"1.3.0"},"policy":[1,{"vesting_seconds":86400,"start_claim":"1970-01-01T00:0
0:00","coin_seconds_earned":"3290619000000","coin_seconds_earned_last_update":"2015-10-08T05:43:06"}]}}
    th_a  vesting_balance_evaluator.cpp:103 do_evaluate

    {"op":{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}}
    th_a  vesting_balance_evaluator.cpp:109 do_evaluate

    {}
    th_a  evaluator.cpp:42 start_evaluate

    {}
    th_a  db_block.cpp:625 apply_operation

    {"trx":{"ref_block_num":5335,"ref_block_prefix":4159425851,"expiration":"2015-10-08T05:43:39","operations":[[33,{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting
_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}]],"extensions":[],"signatures":["1f6f7ea6a4188c8fc36aaf457b5fe4433fb74af11b25050
7262a00d909af025ad065c03ef0f61925070489d1630a3fbe459795b265200544de9ba1694414fefbcf"]}}
    th_a  db_block.cpp:608 _apply_transaction

    {"next_block.block_num()":70872}
    th_a  db_block.cpp:511 _apply_block


Same issue here. My build was bfef440968e98219612a9bbd24e715e8835ad975 "fork_database.cpp:  Fix overflow".
delegate.baozi, in.abit and delegate-clayop were on the same fork.
Anyway I'm rebuilding with latest commit now. It should be fixed by this:

Quote from: wuyanren on October 08, 2015, 02:46:38 pm

Every day so many witnesses are not online, what is the reason?

We've identified an issue where the assignment of new object ID's is inconsistent (we use a hashed index with an undefined iteration order).  Fortunately the testnet's main fork has them in increasing order (I suspect it has to do with the memory allocator tending to put things allocated later at higher addresses), in the next hardfork this condition will be enforced (by replacing most of our hashed indexes with ordered indexes).  We suspect some witnesses are getting their state wrong when they assign an ID differently from the main network, if someone publishes a transaction using that ID then the wrong state turns into a desync (they'll no longer sign or pay attention to blocks on the main fork because they think the main fork has an illegal transaction.)

If you get stuck and the first error message mentions a vesting balance object, this is almost certainly what's happening to you.

The next hardfork will fix this issue, and in addition, I'm working on a tool to help us find if there are any similar issues.

The transactions being executed by the community testers have been incredibly helpful to us.

My observer node got out of sync as well.

Looks like it's stuck at the fork produced by delegate.baozi 

Caused by:
2015-10-08T05:43:09 th_a:invoke handle_block         handle_block ] Got block: #70871 time: 2015-10-08T05:43:09 latency: 573 ms from:
elmato  irreversible: 70846 (-25)                 application.cpp:394
2015-10-08T05:43:13 th_a:invoke handle_transaction   handle_transaction ] Got transaction from network                  application.cp
p:438
2015-10-08T05:43:15 th_a:invoke handle_block         handle_block ] Got block: #70872 time: 2015-10-08T05:43:15 latency: 398 ms from: init9  irreversible: 70847 (-25)                  application.cpp:394
2015-10-08T05:43:15 th_a:invoke handle_block          _push_block ] Failed to push new block:
10 assert_exception: Assert Exception
vbo.is_withdraw_allowed( now, op.amount ):
    {"now":"2015-10-08T05:43:09","op":{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}},"vbo":{"id":"1.13.60","owner":"1.2.8517","balance":{"amount":197500000,"asset_id":"1.3.0"},"policy":[1,{"vesting_seconds":86400,"start_claim":"1970-01-01T00:00:00","coin_seconds_earned":"3341610000000","coin_seconds_earned_last_update":"2015-10-08T05:43:06"}]}}
    th_a  vesting_balance_evaluator.cpp:103 do_evaluate

    {"op":{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}}
    th_a  vesting_balance_evaluator.cpp:109 do_evaluate

    {}
    th_a  evaluator.cpp:42 start_evaluate

    {}
    th_a  db_block.cpp:625 apply_operation

    {"trx":{"ref_block_num":5335,"ref_block_prefix":4159425851,"expiration":"2015-10-08T05:43:39","operations":[[33,{"fee":{"amount":100000,"asset_id":"1.3.0"},"vesting_balance":"1.13.60","owner":"1.2.8517","amount":{"amount":45300000,"asset_id":"1.3.0"}}]],"extensions":[],"signatures":["1f6f7ea6a4188c8fc36aaf457b5fe4433fb74af11b250507262a00d909af025ad065c03ef0f61925070489d1630a3fbe459795b265200544de9ba1694414fefbcf"]}}
    th_a  db_block.cpp:608 _apply_transaction
    {"next_block.block_num()":70872}
    th_a  db_block.cpp:511 _apply_block                 db_block.cpp:191



Witness node crashed.
463719ms th_a       fork_database.cpp:57          push_block           ] Pushing block to fork database that failed to link: 0001159f760df617a20b8b8091820f229d707e17, 71071
463719ms th_a       fork_database.cpp:58          push_block           ] Head: 71200, 00011620289c0a9af56a59ba52e88f1841fcc5bf
463719ms th_a       application.cpp:422           handle_block         ] Error when pushing block:
3080000 unlinkable_block_exception: unlinkable block
block does not link to known chain
    {}
    th_a  fork_database.cpp:78 _push_block

    {"new_block":{"previous":"0001159efd84ad55e9ec8ececf862be1b33b5d40","timestamp":"2015-10-08T05:55:45","witness":"1.6.1","transaction_merkle_root":"0000000000000000000000000000000000000000","extensions":[],"witness_signature":"1f2d5c37139be7915ed09fe135a7364a97b3194ac66dfdfa273aa18b30c87d80fd39a12848c7ca16ad03305c376544d39bb469e8b88a18c758a6bc1023212d9fd8","transactions":[]}}
    th_a  db_block.cpp:197 _push_block
witness_node: /app/bts/graphene-test6.1/libraries/net/node.cpp:1594: void graphene::net::detail::node_impl::schedule_peer_for_deletion(const peer_connection_ptr&): Assertion `_closing_connections.find(peer_to_delete) == _closing_connections.end()' failed.

Program received signal SIGABRT, Aborted.
[Switching to Thread 0x7ffff3581700 (LWP 7034)]
0x00007ffff6c01cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56



Thanks Fox, I did create the witness:

Code: [Select]

get_witness delegate.verbaltech
{
  "id": "1.6.34",
  "witness_account": "1.2.22441",
  "last_aslot": 0,
  "signing_key": "GPH6oUevPDj52JK67E199jBAMBuh6CQBQGgkyLtoXKiAvTVCpvYU7",
  "vote_id": "1:45",
  "total_votes": 0,
  "url": "https://bitsharestalk.org/index.php/topic,13837.0.html",
  "total_missed": 0,
  "last_confirmed_block_num": 0
}

but when I tried to upgrade it I got this error:

Code: [Select]

unlocked >>> upgrade_account delegate.verbaltech true                                                       
upgrade_account delegate.verbaltech true
10 assert_exception: Assert Exception
[glow=red,2,300]!account_obj.is_lifetime_member(): [/glow]
    {}
    th_a  wallet.cpp:898 upgrade_account

    {"name":"delegate.verbaltech"}
    th_a  wallet.cpp:909 upgrade_account
unlocked >>> list_account_balances delegate.verbaltech

list_account_balances delegate.verbaltech
20027 CORE

See that ! in there, that leads me to believe the account is NOT (!) a lifetime member. The cmd did produce an exception. If it meant it was ALREADY a lifetime member the message is fucked. Just one more to add to the list I guess!

If you can create witness, you are already a lifetime member.

@puppies "dele-puppy" is missing blocks

Price feeding is active.

Quote from: Thom on October 05, 2015, 06:31:31 pm

What the bleep is going on! Dam if it's not one thing it's another.

Code: [Select]

admin@seed06:~/.BitShares2_bin$ ls -ls
total 822568
    0 lrwxrwxrwx 1 admin admin       38 Oct  5 18:38 cli_wallet -> cli_wallet_2015-10-05_test6-1-g60b5228
79456 -rwxr-xr-x 1 admin admin 81361534 Oct  5 17:01 cli_wallet_2015-10-05_test6
80464 -rwxr-xr-x 1 admin admin 82394008 Oct  5 18:32 cli_wallet_2015-10-05_test6-1-g60b5228
32304 -rw-r--r-- 1 admin admin 33079187 Oct  5 18:51 test6bin.tgz
    0 lrwxrwxrwx 1 admin admin       40 Oct  5 18:38 witness_node -> witness_node_2015-10-05_test6-1-g60b5228
76960 -rwxr-xr-x 1 admin admin 78803733 Oct  5 17:01 witness_node_2015-10-05_test6
78172 -rwxr-xr-x 1 admin admin 80045408 Oct  5 18:32 witness_node_2015-10-05_test6-1-g60b5228

Major difference in the binaries between those produced on the VPS vs my dev machine. Thought for sure that was the issue, but NOT!

I had no issues before with the build methodology I used for the testnet, now all lthe sudden shit is different. Ultra bummer.

There has got to be a silly stupid change made somewhere. I am going to compile test5 again and see if the binaries differ and if it runs. If it does then whatever is different is not on my end. You all will hear some explitives if that is the case. I doubt it is but I've spent WAY too much time dealing with this today and must go now. If test5 is built and runs without this silly json read error I know something else is the problem.

The only thing that may be the cause on my end I could see is the release flag, since nobody has bothered to answer THAT question. It will SUCK if it turns out that is the culprit. It really wouldn't surprise me tho. It just would be nice if I could get a straight answer. It will require changing wackou's code to fix that, which is not a big deal to do but the point is it shouldn't be necessary and it has cost me alot of time that those tools are supposed to save. The flags he uses to build the code have always worked before.

If the -D CMAKE_BUILD_TYPE=Release definition is so crucial and is not the same as not defining it why is that so damned hard to answer? The build default should be release and the exception debug. Reversing it (if that is what has been done) has screwed at least 2 people.

Edit: just to make sure it wasn't the json file itself I used an old one, but still got the same error.

At the risk of beating that poor horse, forgive me, : ) I still believe it may have to do with the location of your json file.

put the .json file in ~/graphene/programs/witness_node  directory and launch without specifying an explicit location


for example

Code: [Select]

cd ~/graphene/programs/witness_node
wget https://github.com/cryptonomex/graphene/releases/download/test6/oct5-genesis.json.zip
unzip oct5-genesis.json.zip

./witness_node --rpc-endpoint "127.0.0.1:8090"  --genesis-json oct5-genesis.json -d oct5 -s "104.236.51.238:2005"

I also changed nothing about my build process and I did not have any issues.  Hope that helps. : )

Forgive me.. I always build with -D CMAKE_BUILD_TYPE=Debug.
No issue.