BitShares Forum

Main => Technical Support => Topic started by: clayop on July 07, 2015, 08:33:43 pm

Title: Can we prove 100k transactions per second when public testnet launches?
Post by: clayop on July 07, 2015, 08:33:43 pm
People are still dubious about BTS 2.0's 100k throughput capability. This is maybe due to that we claimed and tested this but haven't proved it yet publicly.

I personally tested it in my VM with flood_network command but I only can produce 120 txs blocks.

If we have the block with 200k txs (since block time is 2 second), we can just screenshot and show it for convincing non-believers.

Any ideas?
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: fav on July 07, 2015, 08:36:21 pm
just wait for the testnet (soonTM) and everyone can proof it
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: Ander on July 07, 2015, 08:42:12 pm
Cant wait for the public testnet, and for people to confirm that 100k tps is possible.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: bytemaster on July 07, 2015, 10:12:05 pm
100K TPS requires over 10 MB/sec of network bandwidth and servers with 32 cores and 256 GB of RAM.    The transaction history will grow at 1000 GB per day.  None of these issues are problems when we have network income of 1 billion dollars per day (assuming 100K per sec $0.20).

What you will be able to verify is that we can "reindex" the blockchain at over 100K TPS because we get to skip signature verification and the total data size is much less. 

What we will be testing with the first test network is 1000 transactions per second and 1 second block intervals.   This should require about 100KB /sec of network bandwidth and be viable on the simple VPS systems that we are using today.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: sudo on July 08, 2015, 12:46:31 am
100K TPS requires over 10 MB/sec of network bandwidth and servers with 32 cores and 256 GB of RAM.    The transaction history will grow at 1000 GB per day.  None of these issues are problems when we have network income of 1 billion dollars per day (assuming 100K per sec $0.20).

What you will be able to verify is that we can "reindex" the blockchain at over 100K TPS because we get to skip signature verification and the total data size is much less. 

What we will be testing with the first test network is 1000 transactions per second and 1 second block intervals.   This should require about 100KB /sec of network bandwidth and be viable on the simple VPS systems that we are using today.


awesome  can‘t wait to see

then how the devshares snapshot?  from bts2.0 or  from devshare0.9.x?

What you will be able to verify is that we can "reindex" the blockchain at over 100K TPS because we get to skip signature verification and the total data size is much less. 

What we will be testing with the first test network is 1000 transactions per second and 1 second block intervals.   This should require about 100KB /sec of network bandwidth and be viable on the simple VPS systems that we are using today.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: Riverhead on July 08, 2015, 01:37:07 am
100K TPS requires over 10 MB/sec of network bandwidth

I'm guessing that capital B wasn't a typo. Do we have any idea what sort of infrastructure requirements Visa has, or perhaps Verizon for tracking cellphone data/minutes usage? I'd imagine it is comparable.

It will be a good problem to have.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: BunkerChainLabs-DataSecurityNode on July 08, 2015, 02:32:47 am
100K TPS requires over 10 MB/sec of network bandwidth

I'm guessing that capital B wasn't a typo. Do we have any idea what sort of infrastructure requirements Visa has, or perhaps Verizon for tracking cellphone data/minutes usage? I'd imagine it is comparable.

It will be a good problem to have.

Yes.. clearly the standard for being a witness is going to be raised significantly.  +5%
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: Riverhead on July 08, 2015, 03:04:07 am
100K TPS requires over 10 MB/sec of network bandwidth

I'm guessing that capital B wasn't a typo. Do we have any idea what sort of infrastructure requirements Visa has, or perhaps Verizon for tracking cellphone data/minutes usage? I'd imagine it is comparable.

It will be a good problem to have.

Yes.. clearly the standard for being a witness is going to be raised significantly.  +5%

As long as the ramp up proceeds at a steady pace; giving us time to sign contracts with data centers, etc.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: arhag on July 08, 2015, 05:35:25 am
100K TPS requires over 10 MB/sec of network bandwidth

I'm guessing that capital B wasn't a typo. Do we have any idea what sort of infrastructure requirements Visa has, or perhaps Verizon for tracking cellphone data/minutes usage? I'd imagine it is comparable.

Considering 100K TPS at 100 bytes per transaction would require more than 10 Megabytes per second and just one signature alone requires 65 bytes... yeah the capital B is not a typo. And if most of the transactions are confidential transactions, we are looking at an order of magnitude or more increase in network bandwidth (in that case, at 100K TPS, 1 Gbps would likely not be enough).
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: clayop on July 08, 2015, 05:46:15 am
What we will be testing with the first test network is 1000 transactions per second and 1 second block intervals.   This should require about 100KB /sec of network bandwidth and be viable on the simple VPS systems that we are using today.

Sounds promising. BTW how many transactions Ethereum can process per second?
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: monsterer on July 08, 2015, 09:06:02 am
What you will be able to verify is that we can "reindex" the blockchain at over 100K TPS because we get to skip signature verification and the total data size is much less. 

I've asked for this clarification before, but lets re-state the question for clarity: the 100K TPS figure that gets quoted, is this for actual generated transactions, or just for blockchain sync?
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: xeroc on July 08, 2015, 09:12:55 am
I've asked for this clarification before, but lets re-state the question for clarity: the 100K TPS figure that gets quoted, is this for actual generated transactions, or just for blockchain sync?
https://bitshares.org/blog/2015/06/08/measuring-performance/
I like it that you are getting more and more critical lately .. +5%!
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: monsterer on July 08, 2015, 09:49:40 am
https://bitshares.org/blog/2015/06/08/measuring-performance/
I like it that you are getting more and more critical lately .. +5%!

There are a lot of wild claims flying about - I am trying to get clarity on the facts. So, according to that doc, and bytemaster's comments above, this claim is only substantiated for blockchain sync, it remains untested on a live network.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: xeroc on July 08, 2015, 10:55:34 am
So, according to that doc, and bytemaster's comments above, this claim is only substantiated for blockchain sync, it remains untested on a live network.
Yes. He claims that ECC signature verification can be paralellized easily by a cluster of nodes and the bottleneck of the network is the "order matching" engine which has to be single-threaded (e.g. atomic) for avoid exploits .. The results from LMAX basically state how to separated authorization (via ECC signature) and execution of orders efficiently .. and that is what graphene is going to do
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: chono on July 08, 2015, 11:08:31 am
https://www.nginx.com/blog/thread-pools-boost-performance-9x/
 maybe this tech can strengthen our performance.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: xeroc on July 08, 2015, 11:26:36 am
https://www.nginx.com/blog/thread-pools-boost-performance-9x/
 maybe this tech can strengthen our performance.
asynchronous processes are the contrary to atomic processes ..
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: clout on July 08, 2015, 09:59:55 pm
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: bytemaster on July 08, 2015, 10:03:55 pm
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...

Could you please provide more accurate information I can quote. 
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: Samupaha on July 11, 2015, 08:56:57 am
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...

Could you please provide more accurate information I can quote.

Press release from 2013 (http://ir.nasdaqomx.com/releasedetail.cfm?ReleaseID=768861):

"Approximately 25 billion messages pass through NASDAQ OMX's U.S. equities and options systems on an active day, which amounts to over 1 million transactions per second in a trading day. During volatile periods, peak message traffic can be double."

Here (https://bitsharestalk.org/index.php/topic,16853.msg215669.html#msg215669) is some earlier discussion about this.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: fran2k on July 14, 2015, 04:48:03 am
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...

Could you please provide more accurate information I can quote.

Press release from 2013 (http://ir.nasdaqomx.com/releasedetail.cfm?ReleaseID=768861):

"Approximately 25 billion messages pass through NASDAQ OMX's U.S. equities and options systems on an active day, which amounts to over 1 million transactions per second in a trading day. During volatile periods, peak message traffic can be double."

Here (https://bitsharestalk.org/index.php/topic,16853.msg215669.html#msg215669) is some earlier discussion about this.

Assuming a 'message' is a transaction then 25 billion tx/ day mean 290k tx/s.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: lakerta06 on July 14, 2015, 05:24:02 am
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...

Could you please provide more accurate information I can quote.

Press release from 2013 (http://ir.nasdaqomx.com/releasedetail.cfm?ReleaseID=768861):

"Approximately 25 billion messages pass through NASDAQ OMX's U.S. equities and options systems on an active day, which amounts to over 1 million transactions per second in a trading day. During volatile periods, peak message traffic can be double."

Here (https://bitsharestalk.org/index.php/topic,16853.msg215669.html#msg215669) is some earlier discussion about this.

Assuming a 'message' is a transaction then 25 billion tx/ day mean 290k tx/s.

Is the market open 24h a day? You assume messages are evenly distributed to 24 hours.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: xeroc on July 14, 2015, 07:04:45 am
Is the market open 24h a day? You assume messages are evenly distributed to 24 hours.
good point .. ehm .. selling point :)

I found this:

Code: [Select]
Pre-Market Trading Hours from 4:00 a.m. to 9:30 a.m.
Market Hours from 9:30 a.m. to 4:00 p.m.
After-Market Hours from 4:00 p.m. to 8:00 p.m.

Quote and order-entry from 4:00 a.m. to 8:00 p.m.
Quotes are open and firm from 4:00 a.m. to 8:00 p.m.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: liondani on July 14, 2015, 07:42:21 am
What we will be testing with the first test network is 1000 transactions per second and 1 second block intervals.   This should require about 100KB /sec of network bandwidth and be viable on the simple VPS systems that we are using today.

Sounds promising. BTW how many transactions Ethereum can process per second?

Good question. I would love to know that too.
Title: Re: Can we prove 100k transactions per second when public testnet launches?
Post by: clout on July 14, 2015, 01:39:59 pm
@bytemaster can you please get rid of the reference to nasdaq transaction processing speed. even a cursory investigation demonstrates that the information you provided is false. it's rather concerning that you are creating a securities exchange without knowing much about the industry...

Could you please provide more accurate information I can quote.
Sorry didn't see your reply. I provided this link in a previous thread so I figured you already had the information http://www.nasdaqtrader.com/Trader.aspx?id=Latencystats