I wake up this morning and I found my delegate client dead:

--- there are now 5 active connections to the p2p network
--- in sync with p2p network
--- there are now 0 active connections to the p2p network
--- there are now 0 active connections to the p2p network
--- there are now 0 active connections to the p2p network
default (unlocked) >>>
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fffedca2700 (LWP 12295)]
0x000000000062420b in fc::exception::to_detail_string(fc::log_level) const () at /home/fabiux/ssd/bitshares_toolkit/libraries/fc/src/exception.cpp:142
142           ss << variant(my->_code).as_string() <<" " << my->_name << ": " <<my->_what<<"\n";
(gdb)


Quote from: spartako on July 14, 2014, 04:53:38 pm

Is it possibile using ags and pts keys as "master keys" and using new generated keys in the genesis block for each dacs?

No, because we don't know the AGS and PTS public key, just the address (hash of public key).  This allows us to verify signatures but not perform other useful tasks.

Ok, it is clear. thanks!

I had a segfault after ~14 hour my client was running:
--- there are now 5 active connections to the p2p network
default (unlocked) >>>
Program received signal SIGSEGV, Segmentation fault.
0x00007ffff647afd0 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
(gdb)

If I restart the client and then I give the quit command, at the exit I have an other segfault:
Program received signal SIGSEGV, Segmentation fault.
fc::detail::average_rate_meter::update_const(unsigned int) const () at /home/fabiux/ssd/bitshares_toolkit/libraries/fc/include/fc/time.hpp:59
59              bool   operator <=( const time_point& t )const                              { return elapsed._count <=t.elapsed._count; }
(gdb)

default (unlocked) >>> about
{
  "bitshares_toolkit_revision": "2c46468de8e587229d54efe47d55fdf599c1da6f",
  "bitshares_toolkit_revision_age": "20 hours ago",
  "fc_revision": "87196008d4dacf292523e0b2e89e3af16e125dde",
  "fc_revision_age": "39 hours ago",
  "compile_date": "compiled on Jul 10 2014 at 09:15:43"
}

System: Ubuntu 12.04

So I relaunched the seed node last night and forgot to unlock the wallet so that is why delegate participation was in the dumps. 

We have some kind of latent bug that only appears to show up after hours of operation where all of a sudden the connection count just starts falling off.  Our seed node dropped from 45 connections to 12 over time (no new connections).... I then relaunch it and it quickly climbed back up to 12.  I then increased the desired connection count and got up to 25. 

If other delegates are seeing similar behavior I would like to know.

Me too I had similar behavior and now I have only 5 connections, I tried to send the command:
network_set_advanced_node_parameters {"desired_number_of_connections":50,  "maximum_number_of_connections": 100}
but I continue to have 5 connections...

I suspect that the fee went up and thus your transaction did not include enough fees to register that delegate.

Code: [Select]

wallet_get_pending_transaction_errors

Yes I think this is the problem:

[
    "ee692e3eb33797aeed06827fd95b944f03f25c89",{
      "code": 31004,   
      "name": "unknown_balance_record",
      "message": "unknown balance record",
      "stack": [{
          "context": {
            "level": "error",
            "file": "balance_operations.cpp",
            "line": 79,
            "method": "evaluate",
            "hostname": "",
            "thread_name": "th_a",
            "timestamp": "20140708T223304.387225"
          },
          "format": "",
          "data": {
            "balance_id": "XTSJRAZ2ESTNrZGwHUhy5eH3bcB5syUXDs8g"
          }
        },{
          "context": {
            "level": "warn",
            "file": "balance_operations.cpp",
            "line": 169,
            "method": "evaluate",
            "hostname": "",
            "thread_name": "th_a",
            "timestamp": "20140708T223304.387279"
          },
          "format": "",
          "data": {
            "*this": {
              "balance_id": "XTSJRAZ2ESTNrZGwHUhy5eH3bcB5syUXDs8g",
              "amount": 3999585934,
              "claim_input_data": ""
            }
          }
        },{
          "context": {
            "level": "warn",
            "file": "operation_factory.hpp",
            "line": 52,
           "method": "evaluate",
            "hostname": "",
            "thread_name": "th_a",
            "timestamp": "20140708T223304.387366"
          },
          "format": "",
          "data": {
            "op": {
              "type": "withdraw_op_type",
              "data": {
                "balance_id": "XTSJRAZ2ESTNrZGwHUhy5eH3bcB5syUXDs8g",
                "amount": 3999585934,
                "claim_input_data": ""
              }
            }
          }
        },{
          "context": {
            "level": "warn",
            "file": "transaction_evaluation_state.cpp",
            "line": 218,
            "method": "evaluate",
            "hostname": "",
            "thread_name": "th_a",
            "timestamp": "20140708T223304.387519"
          },
          "format": "",
          "data": {
            "trx": {   
              "expiration": "20140708T235019",
              "delegate_slate_id": null,
              "operations": [{
                  "type": "register_account_op_type",
                  "data": {
                    "name": "spartako7",
                    "public_data": null,
                    "owner_key": "XTS5s7xkzFWgV6JN6r1knKgsLRBtuKgRyJ5e8E6WU7x3M2yop5AmV",
                    "active_key": "XTS5s7xkzFWgV6JN6r1knKgsLRBtuKgRyJ5e8E6WU7x3M2yop5AmV",
                    "delegate_pay_rate": 100,
                    "meta_data": null
                  }
                },{
                  "type": "withdraw_op_type",
                  "data": {
                    "balance_id": "XTSJRAZ2ESTNrZGwHUhy5eH3bcB5syUXDs8g",
                    "amount": 3999585934,
                    "claim_input_data": ""
                  }
                }
              ],
              "signatures": [
                "201c1ac227aafa4d63b63e484a320b75a28fc89d6a8e2f111b6c28c6dc2556e1a1a724d7c0ce62df524f528e25116f738b94a94d2d2cb8bc0a71ba9c70461dcdac"
              ]
            }
          }
        },{
          "context": {
            "level": "warn",
            "file": "chain_database.cpp",
            "line": 1148,
            "method": "evaluate_transaction",
            "hostname": "",
            "thread_name": "th_a",
            "timestamp": "20140708T223304.387648"
          },
          "format": "",
          "data": {
            "trx": {   
              "expiration": "20140708T235019",
              "delegate_slate_id": null,
              "operations": [{
                  "type": "register_account_op_type",
                  "data": {
                    "name": "spartako7",
                    "public_data": null,
                    "owner_key": "XTS5s7xkzFWgV6JN6r1knKgsLRBtuKgRyJ5e8E6WU7x3M2yop5AmV",
                    "active_key": "XTS5s7xkzFWgV6JN6r1knKgsLRBtuKgRyJ5e8E6WU7x3M2yop5AmV",
                    "delegate_pay_rate": 100,
                    "meta_data": null
                  }
                },{
                  "type": "withdraw_op_type",
                  "data": {
                    "balance_id": "XTSJRAZ2ESTNrZGwHUhy5eH3bcB5syUXDs8g",
                    "amount": 3999585934,
                    "claim_input_data": ""
                  }
                }
              ],
              "signatures": [
                "201c1ac227aafa4d63b63e484a320b75a28fc89d6a8e2f111b6c28c6dc2556e1a1a724d7c0ce62df524f528e25116f738b94a94d2d2cb8bc0a71ba9c70461dcdac"
              ]
            }
          }
        }
      ]
    }
  ]
]


I tried to register 10 delegate and this is the transaction_history:
default (unlocked) >>> wallet_account_transaction_history
     BLK.TRX  TIMESTAMP           FROM                TO                  AMOUNT                FEE                 MEMO                                   ID     
-------------------------------------------------------------------------------------------------------------------------------------------------------------------
     775.1    2014-07-08T21:46:00 spartako            spartako            0.00000 XTS           17,367.45297 XTS    register spartako as a delegate        d5d09ff7
     788.1    2014-07-08T21:48:10 spartako            spartako1           0.00000 XTS           22,149.27722 XTS    register spartako1 as a delegate       274df756
     788.0    2014-07-08T21:48:10 spartako            spartako2           0.00000 XTS           22,149.27722 XTS    register spartako2 as a delegate       24c7923b
     789.2    2014-07-08T21:48:20 spartako            spartako5           0.00000 XTS           28,287.09901 XTS    register spartako5 as a delegate       ccb6547e
     789.1    2014-07-08T21:48:20 spartako            spartako3           0.00000 XTS           28,287.09901 XTS    register spartako3 as a delegate       9f84851e
     789.0    2014-07-08T21:48:20 spartako            spartako4           0.00000 XTS           28,287.09901 XTS    register spartako4 as a delegate       3a0849f1
     801.0    2014-07-08T21:50:20 spartako            spartako6           0.00000 XTS           39,995.85934 XTS    register spartako6 as a delegate       d7de0681
   PENDING    2014-07-08T21:50:20 spartako            spartako7           0.00000 XTS           39,995.85934 XTS    register spartako7 as a delegate       ee692e3e
     802.1    2014-07-08T21:50:30 spartako            spartako10          0.00000 XTS           45,535.20458 XTS    register spartako10 as a delegate      ba127d7a
     802.2    2014-07-08T21:50:30 spartako            spartako9           0.00000 XTS           45,535.20458 XTS    register spartako9 as a delegate       c648776b
     802.0    2014-07-08T21:50:30 spartako            spartako8           0.00000 XTS           45,535.20458 XTS    register spartako8 as a delegate       b63c3c29

The cost of the last transaction is 3X than the first one, I suppose because change the "Average Block Transaction Fees" in the formula:
Expected Delegate Pay = Average Block Transaction Fees * BLOCKS_PER_2_WEEKS / 101

I have the registration of spartako7 PENDING for long time (more than 10 minutes)

Quote from: xeroc on July 07, 2014, 10:49:03 am

Quote from: lzr1900 on July 07, 2014, 10:43:31 am

what's going on?
the security state turn to red alert!

There's a sync bug in the git-master .. and a few delegates have a auto-make toolchain installed .. so they cant sync atm ..

It is a good opportunity to act like we would on the real chain...
we can vote up delegates that successfully produced the last blocks and some stand-by delegates to test them out and take our votes back for delegates that lost the last blocks (even if they have over all great statistics)....
That action will be temporary until "blockchain_average_delegate_participation" is over 70% again for example.... When we know that we have the problem behind us (bug,attacks ddos etc.) we can vote again our favorite delegates....)


PS
It would be great if there was available a command that informed us which delegates  has missed their last 5 blocks for example and which one produced successful their last 5...
so we could very quick make the "right" votes to bring the network to a better "blockchain_average_delegate_participation" percentage...

I voted for you and now you are in the top 100:
334   liondani                        0.0505564810 % 64       1        98.46 %       99 %     0.45385 XTS     14534     
Do you have other delegates so I can vote for them?

It should be very useful having some short time analytics on the delegate behavior to take decision in events like this one.

I just wake up and I find my client with delegates with 0 connections, this is the console log that I found:

Peer 146.185.186.245:56182 disconnected us: You offered us a block that we reject as invalid
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 30 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 31 active connections to the p2p network
--- there are now 32 active connections to the p2p network
--- there are now 33 active connections to the p2p network
--- there are now 0 active connections to the p2p network

I restarted the client and now I have 12 connections

EDIT:
emski suggest me to check my p2p.log and I found similar log error (the ip address is the same):

20140707T030112.485619       th_a          accept_loop ] accepted inbound connection from 61.177.35.218:64623                   node.cpp:2446
20140707T030112.487557       th_a    accept_connection ] established inbound connection from 61.177.35.218:64623, sending hello                 peer_connection.cpp:53
20140707T030113.765456       th_a terminate_inactive_c ] Forcibly disconnecting from handshaking peer  due to inactivity of at least 5 seconds                  node.cpp:835
20140707T030113.765514       th_a terminate_inactive_c ] Peer's negotiating status: closing, bytes sent: 0, bytes received: 0                   node.cpp:839
20140707T030113.765551       th_a terminate_inactive_c ] Forcibly disconnecting from handshaking peer  due to inactivity of at least 5 seconds                  node.cpp:835
20140707T030113.765574       th_a terminate_inactive_c ] Peer's negotiating status: closing, bytes sent: 0, bytes received: 0                   node.cpp:839
20140707T030113.765605       th_a terminate_inactive_c ] Forcibly disconnecting from handshaking peer  due to inactivity of at least 5 seconds                  node.cpp:835
20140707T030113.765627       th_a terminate_inactive_c ] Peer's negotiating status: closing, bytes sent: 0, bytes received: 0                   node.cpp:839
20140707T030113.765656       th_a terminate_inactive_c ] Forcibly disconnecting from handshaking peer  due to inactivity of at least 5 seconds                  node.cpp:835
20140707T030113.765677       th_a terminate_inactive_c ] Peer's negotiating status: closing, bytes sent: 0, bytes received: 0                   node.cpp:839
20140707T030113.765707       th_a terminate_inactive_c ] Forcibly disconnecting from handshaking peer  due to inactivity of at least 5 seconds                  node.cpp:835
20140707T030113.765728       th_a terminate_inactive_c ] Peer's negotiating status: closing, bytes sent: 0, bytes received: 0                   node.cpp:839
20140707T030113.765769       th_a terminate_inactive_c ] Sending a keepalive message to peer 89.231.94.1:56559 who hasn't sent us any messages in the last 18 seconds                   node.cpp:905
20140707T030113.765795       th_a terminate_inactive_c ] Sending a keepalive message to peer 188.138.107.159:47755 who hasn't sent us any messages in the last 18 seconds                       node.cpp:905
20140707T030114.687815       th_a            read_loop ] disconnected 11 eof_exception: End Of File
End of file
    {"message":"End of file"}
    asio  asio.cpp:22 read_write_handler

    {"len":16}
    th_a  stcp_socket.cpp:73 readsome                   message_oriented_connection.cpp:144