[OVER] New Public XTS Test for Developers and Savvy Users

[alt]

feed node have received your shake hand request
But don't know why, it just  refused your connection....

Code Select Expand


42 3455479ms       th_a on_connection_reject ] Received a rejection in response to my "hello"   node.cpp:1196


No connections :-(

Would be nice if we could somehow figure this out

[xeroc]

My full info:

Code Select Expand


  1 3451814ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/fork_number_db is not upgradeable   upgrade_leveldb.cpp:44
  2 3451821ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/fork_db is not upgradeable   upgrade_leveldb.cpp:44
  3 3451827ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/property_db is not upgradeable   upgrade_leveldb.cpp:44
  4 3451832ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/proposal_db is not upgradeable   upgrade_leveldb.cpp:44
  5 3451840ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/proposal_vote_db is not upgradeable   upgrade_leveldb.cpp:44
  6 3452095ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/undo_state_db is not upgradeable   upgrade_leveldb.cpp:44
  7 3452100ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/block_num_to_id_db is not upgradeable   upgrade_leveldb.cpp:44
  8 3452105ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/block_id_to_block_db is not upgradeable   upgrade_leveldb.cpp:44
  9 3452109ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/pending_transaction_db is not upgradeable   upgrade_leveldb.cpp:44
10 3452114ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/asset_db is not upgradeable   upgrade_leveldb.cpp:44
11 3452118ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/balance_db is not upgradeable   upgrade_leveldb.cpp:44
12 3452125ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/name_db is not upgradeable   upgrade_leveldb.cpp:44
13 3452129ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/name_index_db is not upgradeable   upgrade_leveldb.cpp:44                                                     
14 3452133ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/symbol_index_db is not upgradeable   upgrade_leveldb.cpp:44
15 3452138ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/delegate_vote_index_db is not upgradeable   upgrade_leveldb.cpp:44
16 3452143ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/ask_db is not upgradeable   upgrade_leveldb.cpp:44
17 3452149ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/bid_db is not upgradeable   upgrade_leveldb.cpp:44
18 3452156ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/short_db is not upgradeable   upgrade_leveldb.cpp:44
19 3452163ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/collateral_db is not upgradeable   upgrade_leveldb.cpp:44
20 3452168ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/chain/processed_transaction_id_db is not upgradeable   upgrade_leveldb.cpp:44
21 3452200ms       th_a       try_upgrade_db ] Database /home/coin/.BitSharesXTS/peers.leveldb is not upgradeable   upgrade_leveldb.cpp:44
22 3452200ms       th_a trigger_p2p_network_ ] Triggering connect loop now   node.cpp:690
23 3455200ms       th_a    set_reuse_address ] Error setting SO_REUSEPORT   tcp_socket.cpp:226
24 3455201ms       th_a connect_to_p2p_netwo ] listening for connections on endpoint 0.0.0.0:5678   node.cpp:1999
25 3455201ms       th_a           connect_to ] node_impl::connect_to(107.170.30.182:5678)   node.cpp:2022
26 3455201ms       th_a    set_reuse_address ] Error setting SO_REUSEPORT   tcp_socket.cpp:167
27 3455201ms       th_a fetch_sync_items_loo ] beginning another iteration of the sync items loop   node.cpp:716
28 3455201ms       th_a fetch_sync_items_loo ] no sync items to fetch right now, going to sleep   node.cpp:752
29 3455201ms       th_a p2p_network_connect_ ] Starting an iteration of p2p_network_connect_loop().   node.cpp:602
30 3455201ms       th_a display_current_conn ] Currently have 1 of 8 connections   node.cpp:975
31 3455201ms       th_a display_current_conn ]    my id is cf90da568ebc72eebae4cc5cf8ee16a285cb7237   node.cpp:976
32 3455201ms       th_a display_current_conn ]    handshaking: 107.170.30.182:5678 with 0000000000000000000000000000000000000000  [outbound]   node.cpp:984
33 3455201ms       th_a p2p_network_connect_ ] Last attempt was 0 seconds ago (disposition: last_connection_failed)   node.cpp:641
34 3455201ms       th_a display_current_conn ] Currently have 1 of 8 connections   node.cpp:975
35 3455201ms       th_a display_current_conn ]    my id is cf90da568ebc72eebae4cc5cf8ee16a285cb7237   node.cpp:976
36 3455201ms       th_a display_current_conn ]    handshaking: 107.170.30.182:5678 with 0000000000000000000000000000000000000000  [outbound]   node.cpp:984
37 3455201ms       th_a p2p_network_connect_ ] Still want to connect to more nodes, but I don't have any good candidates.  Trying again in 15 seconds   node.cpp:669
38 3455201ms       th_a     fetch_items_loop ] beginning an iteration of fetch items (0 items to fetch)   node.cpp:773
39 3455201ms       th_a advertise_inventory_ ] beginning an iteration of advertise inventory   node.cpp:822
40 3455386ms       th_a           connect_to ] established outbound connection to 107.170.30.182:5678   node.cpp:460
41 3455387ms       th_a      connect_to_task ] Sent "hello" to remote peer 107.170.30.182:5678   node.cpp:1933
42 3455479ms       th_a on_connection_reject ] Received a rejection in response to my "hello"   node.cpp:1196
43 3455480ms       th_a            read_loop ] disconnected eof
44 End of file
45     {"message":"End of file"}
46     asio  asio.cpp:22 read_write_handler
47
48     {"len":16}
49     th_a  stcp_socket.cpp:74 readsome   message_oriented_connection.cpp:131
50 3455480ms       th_a on_connection_closed ] Remote peer 107.170.30.182:5678 closed their connection to us   node.cpp:1540
51 3455480ms       th_a display_current_conn ] Currently have 0 of 8 connections   node.cpp:975
52 3455480ms       th_a display_current_conn ]    my id is cf90da568ebc72eebae4cc5cf8ee16a285cb7237   node.cpp:976
53 3455480ms       th_a trigger_p2p_network_ ] Triggering connect loop now   node.cpp:690
54 3455480ms       th_a p2p_network_connect_ ] Starting an iteration of p2p_network_connect_loop().   node.cpp:602
55 3455480ms       th_a display_current_conn ] Currently have 0 of 8 connections   node.cpp:975
56 3455480ms       th_a display_current_conn ]    my id is cf90da568ebc72eebae4cc5cf8ee16a285cb7237   node.cpp:976
57 3455480ms       th_a p2p_network_connect_ ] Last attempt was 0 seconds ago (disposition: last_connection_rejected)   node.cpp:641
58 3455480ms       th_a display_current_conn ] Currently have 0 of 8 connections   node.cpp:975
59 3455480ms       th_a display_current_conn ]    my id is cf90da568ebc72eebae4cc5cf8ee16a285cb7237   node.cpp:976
60 3455480ms       th_a p2p_network_connect_ ] Still want to connect to more nodes, but I don't have any good candidates.  Trying again in 15 seconds   node.cpp:669
61 3460208ms       upnp           operator() ] No valid UPnP IGDs found   upnp.cpp:145
62 3462200ms       th_a        delegate_loop ] next block time: 19700101T000000  interval: 30 seconds  now: 20140530T095742   client.cpp:78
63 3464200ms       th_a        delegate_loop ] next block time: 19700101T000000  interval: 30 seconds  now: 20140530T095744   client.cpp:78
64 3466201ms       th_a        delegate_loop ] next block time: 19700101T000000  interval: 30 seconds  now: 20140530T095746   client.cpp:78
65 3468201ms       th_a        delegate_loop ] next block time: 19700101T000000  interval: 30 seconds  now: 20140530T095748   client.cpp:78


Code Select Expand


(wallet closed) >>> get_info
{
  "blockchain_asset_reg_fee": 301988160,
  "blockchain_asset_shares_max": 1000000000000000,
  "blockchain_bips_per_share": 12.5,
  "blockchain_block_fee_min": 1,
  "blockchain_block_interval": 30,
  "blockchain_block_num": 0,
  "blockchain_block_size_max": 209715,
  "blockchain_block_size_target": 104857,
  "blockchain_delegate_fire_votes_min": 11428571428571,
  "blockchain_delegate_num": 7,
  "blockchain_delegate_reg_fee": 43141165,
  "blockchain_delegate_reward_min": 200,
  "blockchain_id": "1ce846fb372b41843c8dde6e1c109921f3e0c927fcf6ba2163166c0bd2b5b441",
  "blockchain_name_size_max": 63,
  "blockchain_name_data_size_max": 4096,
  "blockchain_random_seed": "0000000000000000000000000000000000000000",
  "blockchain_shares": 80000000000000,
  "blockchain_size_max": 107374182400,
  "blockchain_symbol": "XTS",
  "blockchain_version": 100,
  "client_httpd_port": 0,
  "client_rpc_port": 0,
  "network_num_connections": 0,
  "network_num_connections_max": 12,
  "network_protocol_version": 100,
  "wallet_balance": 0,
  "wallet_balance_bips": 0,
  "wallet_open": false,
  "wallet_unlocked_until": "",
  "wallet_version": 100,
  "_bitshares_toolkit_revision": "2b520584e8ee10be9347d12c1c2a9f13b6f474a2",
  "_fc_revision": "54c66bbb86770d5d166c8b172b2658e9103e37cb",
  "_network_node_id": "cf90da568ebc72eebae4cc5cf8ee16a285cb7237"
}


No connections :-(

Would be nice if we could somehow figure this out

[wackou]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


compile and try again.

that fixed it for me, both on the machine with public ip and the one in the virtualbox.

[mauritso]

Probably nothing, running the client for more than a day now.

The output when doing nothing (for a while) is:

Code Select Expand

UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.
UPnP Port Mapping successful.


Etc.

Is that expected behaviour or is there something wrong with UPnP on my end?

[xeroc]

When I run

Code Select Expand


watch -n1 "netstat -nap  | grep 107.170.30.182"
and do a

Code Select Expand


network_add_node "107.170.30.182:5678" onetry

no connection appears :-(

When relaunching the bitshares deamon I could see a udp port open up .. and closing again after a few seconds

Code Select Expand

tcp        0      0 0.0.0.0:5678            0.0.0.0:*               LISTEN      5885/bitshares_clie
udp        0      0 0.0.0.0:50682           0.0.0.0:*                           5885/bitshares_clie


//EDIT:
interestingly:

Code Select Expand


36 3243129ms       th_a display_current_conn ]    handshaking: 107.170.30.182:5678 with 0000000000000000000000000000000000000000  [outbound]   node.cpp:986
37 3243129ms       th_a p2p_network_connect_ ] Still want to connect to more nodes, but I don't have any good candidates.  Trying again in 15 seconds   node.cpp:671
38 3243129ms       th_a     fetch_items_loop ] beginning an iteration of fetch items (0 items to fetch)   node.cpp:775
39 3243129ms       th_a advertise_inventory_ ] beginning an iteration of advertise inventory   node.cpp:824
40 3243315ms       th_a           connect_to ] established outbound connection to 107.170.30.182:5678   node.cpp:462
41 3243316ms       th_a      connect_to_task ] Sent "hello" to remote peer 107.170.30.182:5678   node.cpp:1935
42 3243409ms       th_a on_connection_reject ] Received a rejection in response to my "hello"   node.cpp:1198
43 3243410ms       th_a            read_loop ] disconnected eof                                                                                                                                       
44 End of file
45     {"message":"End of file"}
46     asio  asio.cpp:22 read_write_handler
47
48     {"len":16}
49     th_a  stcp_socket.cpp:74 readsome   message_oriented_connection.cpp:131
50 3243410ms       th_a on_connection_closed ] Remote peer 107.170.30.182:5678 closed their connection to us   node.cpp:1542



[xeroc]

you should run netstat  after run bitshares_client.
what's the connect state to seed node: 107.170.30.182?
and you can run:

Code Select Expand


telnet 107.170.30.182 5678

test if you can connect  to the seed node.

If you can't telnet to the host, it's because of the network problem, you should add other node.
If you can telnet, but bitshares_client can't complete shaking hand with seed node, modify the souce code should work.

Code Select Expand

nc 107.170.30.182 5678
�t;AU��DҸ�l�7�

[alt]

you should run netstat  after run bitshares_client.
what's the connect state to seed node: 107.170.30.182?
and you can run:

Code Select Expand


telnet 107.170.30.182 5678

test if you can connect  to the seed node.

If you can't telnet to the host, it's because of the network problem, you should add other node.
If you can telnet, but bitshares_client can't complete shaking hand with seed node, modify the souce code should work.

[xeroc]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


That's a no go on my side .. same thing :-( no connections

netstat -ap | grep bitshares
what's the output?

Code Select Expand


tcp        0      0 0.0.0.0:5678            0.0.0.0:*               LISTEN      5472/bitshares_clie

[alt]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


That's a no go on my side .. same thing :-( no connections

netstat -ap | grep bitshares
what's the output?

[muse-umum]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


That's a no go on my side .. same thing :-( no connections

Wow, man you really need to burn your computer.

[xeroc]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


That's a no go on my side .. same thing :-( no connections

[alt]

libraries/net/node.cpp, line 455, remove 3 lines:

Code Select Expand


//        if (local_endpoint.valid())
//          _message_connection.connect_to(remote_endpoint, *local_endpoint);
//        else


compile and try again.

I tested on a few more configs, here are my findings:

test machines:
- vps: debian stable + required libs from testing (boost 1.55, cmake), running on a virtual server with public IP
- vbox: debian stable + required libs from testing (boost 1.55, cmake), running in a virtualbox on my macbook
- macbook: OSX10.9, client precompiled by bytemaster

connection results:
- macbook has no problem connecting, tested at work and at home
- neither vps nor vbox can connect. I thought it was because of the public ip at first, but then vbox should be able to connect, however it doesn't. I tried launching it with --server, although I don't see why it should help, and it didn't. I also tried running vbox with bridge mode instead of NAT, to no avail. Did those multiple times, and after deleting ~/.Bitshares too.

So it looks like it might not be due to having a public ip but rather some problem with the config I'm using (some lib in debian that doesn't work but works in ubuntu?), or the upnp code not working properly in linux.

Here's the version I tried:

Code Select Expand

(wallet closed) >>> get_info
{
  "blockchain_asset_reg_fee": 301988160,
  "blockchain_asset_shares_max": 1000000000000000,
  "blockchain_bips_per_share": 12.5,
  "blockchain_block_fee_min": 1,
  "blockchain_block_interval": 30,
  "blockchain_block_num": 0,
  "blockchain_block_size_max": 209715,
  "blockchain_block_size_target": 104857,
  "blockchain_delegate_fire_votes_min": 11428571428571,
  "blockchain_delegate_num": 7,
  "blockchain_delegate_reg_fee": 43141165,
  "blockchain_delegate_reward_min": 200,
  "blockchain_id": "ed2c3dba64a343002734f782bb3bc831a99a14c80490b85bfbf33751793469cc",
  "blockchain_name_size_max": 63,
  "blockchain_name_data_size_max": 4096,
  "blockchain_random_seed": "0000000000000000000000000000000000000000",
  "blockchain_shares": 80000000000000,
  "blockchain_size_max": 107374182400,
  "blockchain_symbol": "XTS",
  "blockchain_version": 100,
  "client_httpd_port": 0,
  "client_rpc_port": 0,
  "network_num_connections": 0,
  "network_num_connections_max": 12,
  "network_protocol_version": 100,
  "wallet_balance": 0,
  "wallet_balance_bips": 0,
  "wallet_open": false,
  "wallet_unlocked_until": "",
  "wallet_version": 100,
  "_bitshares_toolkit_revision": "70766ff1b1c737b988c9d27f9f4802984ba388b7",
  "_fc_revision": "54c66bbb86770d5d166c8b172b2658e9103e37cb",
  "_network_node_id": "365be6ac70a1dfbc69f331f44db6a90fa8d02c42"
}

Also, by looking at the diff between the logs, here's what I get on osx when it connects:

Code Select Expand


3184005ms       th_a connect_to_p2p_netwo ] listening for connections on endpoint 0.0.0.0:5678          node.cpp:1850
3184005ms       th_a           connect_to ] node_impl::connect_to(107.170.30.182:5678)          node.cpp:1873

and then:

Code Select Expand


3184255ms       th_a           connect_to ] established outbound connection to 107.170.30.182:5678          node.cpp:440
3184255ms       th_a      connect_to_task ] Sent "hello" to remote peer 107.170.30.182:5678         node.cpp:1786
3184380ms       th_a on_hello_reply_messa ] Received a reply to my "hello" from 107.170.30.182:5678, connection is accepted         node.cpp:1034


and here's the same place in the log for the linux client which doesn't:

Code Select Expand


2770636ms       th_a connect_to_p2p_netwo ] listening for connections on endpoint 0.0.0.0:5678                  node.cpp:1999
2770636ms       th_a           connect_to ] node_impl::connect_to(107.170.30.182:5678)                  node.cpp:2022
2770637ms       th_a           connect_to ] Exception binding outgoing connection to desired local endpoint: bind: Address already in use                       tcp_socket.cpp:104

and then

Code Select Expand


2775645ms       upnp           operator() ] No valid UPnP IGDs found                    upnp.cpp:145


let me know if there's anything else I can do to help. Also, should I report this to github or is here a good place to discuss?

[bodenliu]

main thing I've learned from this is that the skill gap between me and Dan+Eric is scary

you guys have done great job!

[toast]

main thing I've learned from this is that the skill gap between me and Dan+Eric is scary

[toast]

Is this going well?  I can't tell from the posts lol.

tl;dr better than I expected

We haven't had to reset even once! Plenty of bugs but most stuff is at the level of the client (usability). Managed to make several very big updates without having to hard fork. Dan thinks we won't even need to reset for TITAN+architecture changes. Good chance this is our last testnet if that's true.

DPOS looks solid so far, what a relief. Big props to Eric for his huge network test suite. Really want to get delegate voting up so we can let people try to really misbehave and split the network.
As a non-delegate, any time I've made a bad change I just got disconnected and the rest of the network chugged along unaffected.

Worst bug so far is that the ECC library is totally broken for 32 bit machines... that's like half the windows users. Also some users experiencing mysterious connection issues. Minor issues w.r.t the network as a whole, but terrible if you're the one experiencing them =P.