BitShares Forum

Main => General Discussion => Topic started by: clayop on October 05, 2015, 01:58:00 am

Title: What Should be the Next Stress Test's Goal?
Post by: clayop on October 05, 2015, 01:58:00 am
The result proved that 1000 TPS for 15 min was too harsh for current witness servers (but some high-end witness VPS survived)
In the next testnet, what is your preference for target TPS and its duration?
Title: Re: What Should be the Next Stress Test's Goal?
Post by: sittingduck on October 05, 2015, 02:49:30 am
Scale back and focus on stability


Sent from my iPhone using Tapatalk
Title: Re: What Should be the Next Stress Test's Goal?
Post by: clayop on October 05, 2015, 02:51:33 am
Scale back and focus on stability

Good point. We should balance in between
Title: Re: What Should be the Next Stress Test's Goal?
Post by: unreadPostsSinceLastVisit on October 05, 2015, 03:07:54 am
wait the stress test is happening? is there a place I was supposed to send the 2500 bts I offered to donate to the cause?
Title: Re: What Should be the Next Stress Test's Goal?
Post by: clayop on October 05, 2015, 03:10:21 am
wait the stress test is happening? is there a place I was supposed to send the 2500 bts I offered to donate to the cause?

It's not for 100k tps.
Title: Re: What Should be the Next Stress Test's Goal?
Post by: tbone on October 05, 2015, 03:32:20 am
Scale back and focus on stability


Sent from my iPhone using Tapatalk

I agree with this.  Also, perhaps going forward all spamming should be coordinated with bytemaster so he can a) observe the network as the spamming occurs, and perhaps more importantly b) so he can restart the testnet if it goes down.  This way we can avoid losing more precious time with the network being down. 


Title: Re: What Should be the Next Stress Test's Goal?
Post by: cube on October 05, 2015, 04:01:24 am
No. Do not scale back.  But wait for BM and team to restore the testnet and fix it up for even higher TPS.  I think it is pre-mature to think of the next TPS goal when the dev team is away for the weekend.  Let's patiently wait for BM.

A note on the load test preparation progress, I am developing test scripts for a load test that includes other functions such as 'create user accounts', 'create asset'.  I hope this would provide a more comprehensive appraoch to the current stress test based solely on a fixed accounts  'core transfer' operation.  I will make the announcement soon.
Title: Re: What Should be the Next Stress Test's Goal?
Post by: wuyanren on October 05, 2015, 05:24:36 am
I think it is now mainly stable, within six months, 200tps can be
Title: Re: What Should be the Next Stress Test's Goal?
Post by: puppies on October 05, 2015, 05:28:49 am
I say push it harder.  Maybe we try a run with just higher powered servers, and no fees.  I want 20k tps. 
Title: Re: What Should be the Next Stress Test's Goal?
Post by: clayop on October 05, 2015, 05:50:08 am
I say push it harder.  Maybe we try a run with just higher powered servers, and no fees.  I want 20k tps.

That can be another private testnet, imo.
Title: Re: What Should be the Next Stress Test's Goal?
Post by: puppies on October 05, 2015, 06:11:52 am
I say push it harder.  Maybe we try a run with just higher powered servers, and no fees.  I want 20k tps.

That can be another private testnet, imo.

Great idea
https://bitsharestalk.org/index.php/topic,18743.new.html#new (https://bitsharestalk.org/index.php/topic,18743.new.html#new)
Title: Re: What Should be the Next Stress Test's Goal?
Post by: r0ach on October 05, 2015, 06:18:55 am
If you're doing a stress test, it would be a lot more useful if you list the hardware in the VPS units used, then what the bottleneck is that you saw...
Title: Re: What Should be the Next Stress Test's Goal?
Post by: puppies on October 05, 2015, 06:27:41 am
If you're doing a stress test, it would be a lot more useful if you list the hardware in the VPS units used, then what the bottleneck is that you saw...

Yeah.  I was hoping to discuss it in the other thread.  Thats why I didn't address it.  I am of the opinion that the bottleneck is single core processor speed.  I think an i5 at home or a $40 a month vps would be a good starting point.  Ultimately we just need to keep performance above 66%.  Learning which nodes are unable to keep up will be just as valuable as learning which nodes are able to keep up.
Title: Re: What Should be the Next Stress Test's Goal?
Post by: bytemaster on October 05, 2015, 01:22:29 pm
For BTS the only thing we  need for the next 6 months is 100 TPS and a stable / reliable set of witnesses. 

For our test networks we can continue to push the limits, but that will have to be done with high quality computers connected to high-bandwidth internet, potentially with very low latency nodes.

At 1000 TPS the bandwidth requirement of the nodes is already near 2 MB per second (assuming the producer broadcasts it to 8 peers and each block is 333KB).    Even at 1MB / sec bandwidth, the minimum latency for a block to TRANSFER from the producer to the first peer is 0.5 seconds.   If the producer is dividing their bandwidth 8 ways then it will require either 4 seconds or 8MB /sec bandwidth just for the blocks.    The actual bandwidth requirements are double that because transactions are sent separately.

In other words, until we rework the protocol to avoid rebroadcasting transactions when we broadcast blocks any peer that is unable to sustain those kinds of data rates will be a problem.

Also, the networking code currently uses more CPU than the blockchain validating code.   Fortunately it runs in its own thread.   Those running on a single core VPS with 1 GB of ram will not be able to keep up.   Those running on a home PC will also not be able to keep up.   
Title: Re: What Should be the Next Stress Test's Goal?
Post by: clayop on October 05, 2015, 03:04:20 pm
Based on the current transaction capability cap as BM mentioned, I am not able to run 300 TPS / 30 minutes stress test.

Instead, I would like to run a 100 TPS / 1 hour stress test, as a final stress test before the 2.0 launch.

It may requires 15~25 VPS (I expect 4~7 TPS per node) and about 400k CORE.

I will determined the test schedule with the cooperation with @bytemaster or other devs and announce it here - https://bitsharestalk.org/index.php/topic,18684.0.html.
Title: Re: What Should be the Next Stress Test's Goal?
Post by: wuyanren on October 05, 2015, 07:09:50 pm
Stable program, is a good program