Author Topic: [Testnet-StressTest] March 15th - 3:00pm UTC  (Read 3657 times)

0 Members and 1 Guest are viewing this topic.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12755
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
[Testnet-StressTest] March 15th - 3:00pm UTC
« on: February 24, 2017, 07:35:23 am »
Hey there,
I finally picked a date for the testnet stress test:

       15th March beginning around 3pm UTC.

Organization
I would like to invite everyone (in particular the witness node operators) to join this Telegram channel:
https://t.me/joinchat/AAAAAA0N-zjsAdcLnUsL6A

Real-Time Stats
Turns out the new middleware for the stats seem to work pretty well. You can see the real-time stats during the stresstest on
http://stats.bitshares.eu  (make sure to select the testnet!)
After the stresstest, when the transactions are all in the blokchain, we can do some offline analysis

Spamming
Currently, the cli-wallet is the fastest to produce transactions
Python Script For the CLI wallet
Code: [Select]
import time
import json
from grapheneapi.grapheneapi import GrapheneAPI

blockinterval    = 2
numbertxperblock = 500

if __name__ == '__main__':
    client = GrapheneAPI("localhost", 8090, "", "")
    while True :
        for i in range(0,numbertxperblock) :
            print(i)
            res = client.transfer("faucet","xeroc","0.001", "TEST", "", True);
        time.sleep(blockinterval)

I hope I can finish up the basic uptick client and add a temporary flooding call there by next week, then you won't need the cli-wallet for it.

Public Witness API
Now that I have set a date, I can order a fat machine for the public API node and monitor it's RAM and bandwidth usage.
The URL will still be

  wss://node.testnet.bitshares.eu

and unless you run your own witness node (which would be very welcome), this node should hopefully have enough resources to stay up and running during the stresstest.

Is there anything else we should discuss in the meantime?
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12755
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #1 on: March 02, 2017, 05:39:52 pm »
I am currently pushing some load on the testnet to see if the frontend and stuff works as desired.

http://stats.bitshares.eu/#test




Looks promising
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12755
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #2 on: March 07, 2017, 03:38:55 pm »
Some more pictures made during my personal testing:


I'd like to thank BTS-Munich for providing some funding to obtain a think machine for the public API node.
You can find more data about the machine (also during stress testing) on
http://stats.bitshares.eu/netdata/
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

Offline Chris4210

  • Global Moderator
  • Sr. Member
  • *****
  • Posts: 428
  • Running for BitShares Committee Member
    • View Profile
    • www.payger.com
  • BitShares: chris4210
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #3 on: March 10, 2017, 02:18:21 pm »
Here is a good tutorial how to set up a test net node thanks to Fox: https://github.com/ryanRfox/BitSharesTESTNET

Good work.
Vote Chris4210 for Committee Member http://bit.ly/1WKC03B! | www.Payger.com - Payments + Messenger | www.BitShareshub.io - Community based fanpage for the BitShares Blockchain

Offline Thom

Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #4 on: March 10, 2017, 05:51:18 pm »
A 32GB, 8 CPU core node on vultr.com is priced at $0.238 / hour.

The are two 32GB options on bithost, one designated "(high memory)", not sure what that means:

1) 32GB
    Monthly Price    $448.00
    Hourly Price    $0.6667

2) 32GB (high memory):
    Monthly Price    $336.00
    Hourly Price    $0.5

One of these (I believe it's Vultr) is a Digital Ocean reseller. Both can take Bitcoin as payment.

I will be researching other VPS hosting options this weekend, as well as deployment options.


Injustice anywhere is a threat to justice everywhere - MLK |  Verbaltech2 Witness Reports: https://bitsharestalk.org/index.php/topic,23902.0.html

Offline FractalNode

  • Full Member
  • ***
  • Posts: 81
    • View Profile
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #5 on: March 12, 2017, 06:37:15 pm »
it seems like this link is broken:
https://t.me/joinchat/AAAAAA0N-zjsAdcLnUsL6A

I've created and synchronize my new Azure DS12 :)
but I still have a few questions to this list from point 12 ii and above
https://github.com/ryanRfox/BitSharesTESTNET

Quote
Use the WIF private key you copied earlier from the ~/brain_key.json file unlocked >>> import_key 5yourPrivateKeyStartsWith5...

>>> import_key accoutname 5KgFzmuA8FXMgFzmuA8FgFzmuA8FgFzmuA8F
true

whether this account must contain TEST tokens?

poin 14
but I don't have any file here :

tail: cannot open ~/testnet/cli_wallet/wallet.json for reading: No such file or directory


« Last Edit: March 12, 2017, 06:44:27 pm by FractalNode »

Offline Fox

Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #6 on: March 13, 2017, 12:08:39 am »
but I still have a few questions to this list from point 12 ii and above
https://github.com/ryanRfox/BitSharesTESTNET

Quote
Use the WIF private key you copied earlier from the ~/brain_key.json file unlocked >>> import_key 5yourPrivateKeyStartsWith5...

>>> import_key accoutname 5KgFzmuA8FXMgFzmuA8FgFzmuA8FgFzmuA8F true
point 14
but I don't have any file here :

tail: cannot open ~/testnet/cli_wallet/wallet.json for reading: No such file or directory

Sorry all, I had poor syntax in my README file. There are three (3) parameters for import_key
Code: [Select]
import_key <account_name> <WIF_private_key> <bool>There for it should look something like:
Code: [Select]
unlocked >>> import_key fox 5ALLprivateKeysStartsWith5andAbunchOfChars true
Also, I neglected to create the /home/$USER_NAME/testnet/cli_wallet folder prior to launching the cli_wallet, so it was unable to save the wallet file. I have now added that to the script so it 'should' function properly. Also, I added the web socket RPC flag to the wallet startup. The relevant code changes are here:
Code: [Select]
##################################################################################################
# Create a script to launch the cli_wallet using a wallet file stored at                         #
# /home/$USER_NAME/$PROJECT/cli_wallet/wallet.json                                               #
##################################################################################################
mkdir /home/$USER_NAME/$PROJECT/cli_wallet/
cat >/home/$USER_NAME/launch-$PROJECT-wallet.sh <<EOL
/usr/bin/$CLI_WALLET -w /home/$USER_NAME/$PROJECT/cli_wallet/wallet.json \
                     -s ws://$LOCAL_IP:$RPC_PORT \
-H 127.0.0.1:$WALLET_HTTP_RPC_PORT \
-r 127.0.0.1:$WALLET_WS_RPC_PORT
EOL
chmod +x /home/$USER_NAME/launch-$PROJECT-wallet.sh
Witness: fox

Offline FractalNode

  • Full Member
  • ***
  • Posts: 81
    • View Profile
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #7 on: March 13, 2017, 08:07:53 pm »
done!
what's next?

btw.
I changed the logging level from debug to info
debug gives 1GB per 1h

Code: [Select]
Azure DS12 v2
E5-2673 v3 @ 2.40GHz,
28 GB Ram

Hosted by NFOrce Entertainment B.V. (Amsterdam) [2.18 km]: 5.332 ms
Testing download speed........................................
Download: 2126.96 Mbit/s
Testing upload speed..................................................
Upload: 445.69 Mbit/s

Code: [Select]
unlocked >>> info
info
{
  "head_block_num": 6856241,
  "head_block_id": "00689e31e66b5eb24ba8c4ddc1dbc065f4bfc7e0",
  "head_block_age": "1 second old",
  "next_maintenance_time": "2 minutes in the future",
  "chain_id": "39f5e2ede1f8bc1a3a54a7914414e3779e33193f1f5693510e73cb7a87617447",
  "participation": "100.00000000000000000",
  "active_witnesses": [
    "1.6.1",
    "1.6.3",
    "1.6.20",
    "1.6.21",
    "1.6.22",
    "1.6.23",
    "1.6.24",
    "1.6.25",
    "1.6.27",
    "1.6.28",
    "1.6.29",
    "1.6.30",
    "1.6.31",
    "1.6.32",
    "1.6.33",
    "1.6.34",
    "1.6.36"
  ],
  "active_committee_members": [
    "1.5.11",
    "1.5.12",
    "1.5.13",
    "1.5.14",
    "1.5.15",
    "1.5.16",
    "1.5.17",
    "1.5.18",
    "1.5.19",
    "1.5.20",
    "1.5.2"
  ]
}
unlocked >>>


I look forward to further guidance
« Last Edit: March 15, 2017, 12:10:40 pm by FractalNode »

Offline abit

  • Committee member
  • Hero Member
  • *
  • Posts: 3488
    • View Profile
    • Steemit Blog
  • BitShares: abit
  • GitHub: abitmore
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #8 on: March 14, 2017, 09:25:23 pm »
[member=120]xeroc[/member] IIUC only one node will be producing blocks, with all witnesses on it?
BTS account: abit
BTS committee member: abit
BTS witness: in.abit

Offline instructor2121

Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #9 on: March 15, 2017, 02:41:50 am »
[member=30537]Chris[/member] Thanks for the tutorial link.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12755
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #10 on: March 15, 2017, 07:11:02 am »
[member=120]xeroc[/member] IIUC only one node will be producing blocks, with all witnesses on it?
I don't quite understand your statement ... the testnet is distributed among 15 witnesses which are placed from South Korea, over Germany and Paris, to AWS in th U.S.
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

Offline abit

  • Committee member
  • Hero Member
  • *
  • Posts: 3488
    • View Profile
    • Steemit Blog
  • BitShares: abit
  • GitHub: abitmore
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #11 on: March 15, 2017, 05:34:07 pm »
[member=120]xeroc[/member] IIUC only one node will be producing blocks, with all witnesses on it?
I don't quite understand your statement ... the testnet is distributed among 15 witnesses which are placed from South Korea, over Germany and Paris, to AWS in th U.S.
Got it. Thanks.

Update:
test report with video: https://steemit.com/bitshares/@chris4210/1h30-min-bitshares-stress-test-of-the-15-march-2017-3300txs-14000ops
« Last Edit: March 17, 2018, 08:06:02 pm by abit »
BTS account: abit
BTS committee member: abit
BTS witness: in.abit

Offline Permie

  • Hero Member
  • *****
  • Posts: 606
  • BitShares is the mycelium of the financial-earth
    • View Profile
  • BitShares: krimduss
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #12 on: March 15, 2017, 06:58:53 pm »
I'd like to thank BTS-Munich for providing some funding to obtain a think machine for the
Thank you BTS Munich and Xeroc, for the benefit of all shareholders
JonnyBitcoin votes for liquidity and simplicity. Make him your proxy?
BTSDEX.COM

Offline Chris4210

  • Global Moderator
  • Sr. Member
  • *****
  • Posts: 428
  • Running for BitShares Committee Member
    • View Profile
    • www.payger.com
  • BitShares: chris4210
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #13 on: March 17, 2017, 01:49:31 pm »
Results of the BitShares Munich Testnet: https://steemit.com/bitshares/[member=38926]Chris4210[/member]/1h30-min-bitshares-stress-test-of-the-15-march-2017-3300txs-14000ops

Other big thanks to all participants and especially for Xeroc and his countless hours to get a great stats page up and moderating the stress test.

I am looking forward to the next stress test soon.
Vote Chris4210 for Committee Member http://bit.ly/1WKC03B! | www.Payger.com - Payments + Messenger | www.BitShareshub.io - Community based fanpage for the BitShares Blockchain

Offline pc

  • Hero Member
  • *****
  • Posts: 1412
    • View Profile
    • Bitcoin - Perspektive oder Risiko?
  • BitShares: cyrano
Re: [Testnet-StressTest] March 15th - 3:00pm UTC
« Reply #14 on: March 17, 2017, 04:18:26 pm »
Excellent results!

Good job guys!
Bitcoin - Perspektive oder Risiko? ISBN 978-3-8442-6568-2 http://bitcoin.quisquis.de