I have created a thread on Gridcoin's forum to drive up interest in this project: https://cryptocointalk.com/topic/53393-brainstorming-bitshares-boinc-project/

Stress-test whitepaper released! : http://docs.bitshares.eu/_downloads/bitshares-stresstest.pdf

Read the above PDF report for the recent stress test within the Bitshares testnet!

Relevant quotes from above whitepaper:

Transaction Production
In  order  to stress-test  a  network, we need to produce actual stress which is not easy to achieve at the scale that we needed for our tests. Furthermore, we wanted to simulate a more or less realistic scenario in which multiple in-dependent parties distributed on the globe produce transactions, each transaction trying to make it into the next block.

For this reasons, we have asked the BitSharesTalk community to participate in the stress-testing not only by means of providng validation  nodes  across  the  planet,  but  also  to  produce  the  re-quired stress.

Sounds like we could help out here!

However, the Peer-2-Peer networking code has been optimized for a block interval of about 10 s and thus leaves a lot of room for  optimizations  when  talking  about  high-throughput  at  low latencies.

Ok so the lack of computer resources available to create transactions wasn't the sole bottleneck for maximizing TPS, this is potentially an area of witness experimentation or machine learning (to find optimal parameter optimization for ranges of TPS load).

Conclusion section
The Peer-2-Peer code seems to be working nicely but results show that it could be one of the bottlenecks currently preventing us from going further. The computational resources of our validators have more than enough back-off for higher throughputs but the networking code was not able to provide sufficient data (e.g. transactions) to raise it during our stress-test.

Ok, so perhaps the lack of computing power isn't required until the network code is optimized?

Content mirrored: https://steemit.com/bitshares/@cm-steem/bitshares-boinc-project-brainstorming-thread-all-ideas-welcome

Hey,

I'm Customminer from the Gridcoin https://gridcoin.us community, I've been a holder of BTS since BTSX days & have a very positive outlook on the future of Bitshares!

I have been paying attention to the recent Bitshares testnet stress-testing https://bitsharestalk.org/index.php/topic,23829.0.html which yielded a rate of approx 3k TX/s, it was mentioned in the 13th Bitshares hangout https://soundcloud.com/beyond-bitcoin-hangouts/bitshares-hangout-13-w-christoph-hering-fuzzy that a potential reason that we were limited to 3k TX/s was the lack of computing power at the disposal of the stress-test organizers - I believe that the BOINC & Gridcoin community can help!

BOINC https://boinc.berkeley.edu/ is an open-source kit for volunteer distributed computing, it can distribute any kind of computing task and has between 250k & 560k active users (differing estimates depending on what site you go to.. it's difficult to guesstimate) & 4 million registered users in total. To put the scale of available computing power in perspective, team Gridcoin has 100k hosts at its disposal and currently only rewards 0.5% of the active BOINC community. The majority of the BOINC community contributes their resources entirely for free, those that crunch under team Gridcoin are rewarded GRC by the network on behalf of whitelisted projects (project owners pay nothing).

I spoke during episode 200 of the BeyondBitcoin hangout https://soundcloud.com/beyond-bitcoin-hangouts/beyondbitcoin-spotlight-gridcoin-03-24-17 and the 14th Bitshares hangout Chris4210[/member]/bitshares-hangout-14-03-31-17]https://steemit.com/bitshares/@Chris4210/bitshares-hangout-14-03-31-17 on this topic.

I try to encourage the development of new BOINC projects each month, join in the discussion: https://steemit.com/@cm-steem/brainstorming-boinc-projects-006

The tools:
https://github.com/marius311/boinc-server-docker
https://github.com/marius311/boinc2docker
https://www.docker.com/
https://github.com/xeroc/python-bitshares
https://github.com/xeroc/bitshares-docker
https://github.com/grctest/project-rain-site (Outdated, needs uplifted to latest BOINC version)

The ideas:

Bitshares Testnet Load Generator!

It was mentioned in the last Bitshares hangout that the Bitshares testnet stress test may have been limited due to a lack of resources available for creating a larger transaction volume - what about distributing testnet load generating software out to a few thousand computers around the world via a BOINC project?

Such a project wouldn't be eligible for Gridcoin whitelist status (no GRC rewards) due to the bursty nature of stress testing (GRC needs continuous work availability).

You could easily distribute an UIA to your volunteers proportionally to their completed work by adding a Bitshares field to the BOINC signup page and user profile.

I'd imagine that for this idea, you would distribute a docker container which contained python dependencies, the testnet stress-test python script, and the bitshares client.

Once running on an user's machine, it would need to create a testnet user account, the project admin would send enough testnet BTS to each volunteer bitshares account, each account would register as lifetime (for less fees, but not neccessary),  then the main stress-test script would begin bombarding testnet with transactions.

The 3000+ TX/s rate achieved in the recent Bitshares testnet stress-test was great, but let's try to push it to 1 million + TX/s!

Relevant links:
Bitshares testnet stress-test thread : https://bitsharestalk.org/index.php?topic=23829.15

---

Bitshares Full/API node distribution

Alongside the testnet load generator, you could distribute full node servers out to volunteers to supply additional network resources to the Bitshares network.

This would require the development of a proof-of-bandwidth credit mechanism (how to reward credit to users based on their full node availability/capacity/consumed-resources).

Since full-nodes are always required, this would make a Bitshares BOINC project eligible for Gridcoin whitelisting.

This would require setting minimum computer spec requirements, so not everyone would be able to participate unlike the load generator.

---

Machine Learning + BTS

You could distribute TensorFlow https://www.tensorflow.org/ docker containers, and perform machine learning against data gathered from the BTS DEX.

---

Witness experiments

We currently have ~25 witnesses, down from 100 in the switch from BTS 1.0 to BTS 2.0, we could experiment with different quantities of witnesses in an automated manner to evaluate optimal quantities of witnesses.

---

Volunteer incentives!

The BOINC web server is programmed in PHP, you can easily add a Bitshares (and bitshares testnet) account field to the account signup page (and profile page), then expose said account name within the user statistics xml files (which is generated every 24hrs) then you can proportionally distribute an UIA on the BTS network to each BOINC volunteer proportionally to their contributed computation (RAC). Since these xml files are public, anyone could distribute their own UIA against your volunteers (new sharedrop vector!).

If there is a continuous availability of work units for volunteers, then the project would be eligible for Gridcoin whitelist status (the Gridcoin network would distribute rewards to your volunteers).

---

Do you have an idea for Bitshares which requires vast amount of distributed computing power? Please post your ideas in this thread! 

Thoughts?

Regards,
CM.

Looks good, I've reported a few bugs using the google bug reporting tool.

Keep up the good work guys

Are you planning on creating an android wallet?

Quote from: crypto123 on March 26, 2017, 02:13:56 am

Thoughts on utilizing a BOINC project to distribute the load generating software required to push the tx/s to new heights? https://steemit.com/beyondbitcoin/@cm-steem/brainstorming-boinc-projects-006#@cm-steem/re-cm-steem-brainstorming-boinc-projects-006-20170326t013749374z

Mentioned the idea on beyondbitcoin #200 too: https://steemit.com/beyondbitcoin/@glitterfart/beyond-bitcoin-radioshow-2017-03-24-gridcoin-raw-recording-for-impatients

What I took away from that conversation is that BOINC would not be suitable for the BitShares testnet to spam the network for testing b/c BOINC projects are geared towards problems where longer term application of CPU resources is required, as opposed to the burst requirements of the testnet. Testing on the testnet is not a continuous, ongoing operation.

I'm not very knowledgeable about BOINC, just commenting on what I heard in the mumble last Friday.

What I meant was that a Bitshares testnet stress-test BOINC project would be unsuitable for Gridcoin whitelist status as the Gridcoin network focuses on projects with continuous work unit distribution, and the nature of stress-tests is bursty & far apart.

Such a BOINC project is entirely possible, you can distribute any kind of distributed computing application. I'd imagine that for this idea, you would distribute a docker container which contained python dependencies, the testnet stress-test python script, and the bitshares client.

Once running on an user's machine, it would need to create a testnet user account, then the project admin would need to send enough testnet BTS to each participating account, then the main stress-test script would begin bombarding testnet with transactions, so it's not as simple as just distributing the bitshares client and the python script.

With regards to rewarding participating users, you could add an BTS account field within the BOINC profile or within the project registration page, to which you could take into account the credit achieved by participating users during the stress-test phases & distribute an UIA proportionally for their completed work.

If you were able to exchange FIAT to <relevant_smartcoin> in stores or at an ATM, then we'd potentially see a massive surge in the use of the smartcoins, no? I'd prefer to use smartcoins to buy goods online instead of BTC because in the time between buying BTC and spending the BTC the value can change due to volatility (far less volatility w/ FIAT).

The poll wouldn't work for me, but I imagine that a large amount of the BTS communtiy is interested in the stealth/anonymity features being introduced to BitShares. There was that article that claimed that the feature is barely used in zcash, but that's because zcash is an ico pump and dump.