BitShares Forum

Other => Graveyard => MemoryCoin => Topic started by: KillerByte on March 17, 2014, 12:50:39 am

Title: P2Pool Beta for Memorycoin
Post by: KillerByte on March 17, 2014, 12:50:39 am
Be among the first to create your own pool node now: https://github.com/KillerByte/p2pool

List of all P2Pools: http://mmcexplorer.info/p2pool

Stratum Mining Software: https://github.com/KillerByte/memoryminer

Pool Example: http://memorycoin.biz:8080/static/

YAM is not currently supported due to the fact it does not support Getwork longpolling. Stratum for YAM is supposed to be coming soon, I have already consulted yvg on the subject.

I got to admit, this project has been quite tedious for the last couple weeks, but I have finally reached the point where it works beta-quality.

Benifits:
* Highly efficient mining protocol
* Completely decentralized solution, no more mining centralization issues
* Instant payouts - included in coinbase transaction so you dont have to ever worry about not getting payed.

No other pool compares!

Python Twisted is the only dependancy.

How to use (obviously be aware of changes needed for your configuration):
Code: [Select]
git clone https://github.com/KillerByte/p2pool
cd p2pool
git submodule sync
git submodule update --init
cd memorycoin_momentum
sudo python setup.py install
cd ..
python run_p2pool.py

Let me know of any troubles.

How to mine:

Code: [Select]
https://github.com/KillerByte/memoryminer
cd memoryminer/src
make -f makefile.unix
./memoryminer -poolip=<your hostname to mine on, ex: memorycoin.biz> -poolport=9332 -pooluser=<your address, ex: MAJNEC7HzAeLPGSYdvvD8gFTxZLfdjzVnj> -genproclimit=<cpu cores>

What should work:

* Stratum Mining Protocol
* Mining a block, if it happens (has been tested on testnet)

What needs to be improved:

* Election blocks (currently does not work, and I dont see how to get it to work at this time...)
* Web interface
* " Punishing share for 'Block-stale detected! height(77149743cc5c387cbe616b8f5a391a57d39332b873a7271783d462b6207c) < height(6ec8ec70f52b74fd63a964c9f35f0eb54bba32915158bc2b2e5c045e5662) or 1f009129 != 1f009148'! Jumping from c46dc9d7 to 4d01520a!" message
* Other little bugs

I also hope to implement some sort of support for p2pool share browsing at mmcexplorer.info, but not sure yet.

So yes! Try, and mine!
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 17, 2014, 02:23:13 am
This is big news.   :D
Great work.
Title: Re: P2Pool Beta for Memorycoin
Post by: Delinquency on March 17, 2014, 04:05:35 am
Someone please roll out a 1% fee pool running with this code!
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 17, 2014, 04:17:38 am
Someone please roll out a 1% fee pool running with this code!

there are already 2 pools (XPOOL is back! http://xpool.xram.co:8080, and my pool - http://memorycoin.biz:9332), each with a 1% fee targeted toward the creator of P2Pool. All you need to do is use the special miner to connect to one of the pools and mine away!

If anyone else chooses to run a pool, a fee for yourself can easily be set with the -f PERCENTAGE option.

You can view all options for P2Pool with --help
Title: Re: P2Pool Beta for Memorycoin
Post by: emre on March 17, 2014, 06:04:50 pm
great work, thanks.

all we need is yam atm.
Title: Re: P2Pool Beta for Memorycoin
Post by: Delinquency on March 17, 2014, 06:08:30 pm
I'm sure yvg may already be working on this fix, if he's competent enough. :-]
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 17, 2014, 10:28:14 pm
I'm sure yvg may already be working on this fix, if he's competent enough. :-]

he sent me a message today and said he should be on it very quickly. There is still much to do with the pool, however, and I have some outside work to do, so it will be a bit of a wait.

I will be porting the pool for XPM over the next couple of days, so that should be interesting and the miners are opensource over there so we will hopefully get a taste of what it will be like.
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 18, 2014, 12:18:38 am
Is this something that will be easy to setup for the average user who wants to setup a pool?
Title: Re: P2Pool Beta for Memorycoin
Post by: Delinquency on March 18, 2014, 12:39:55 am
Is this something that will be easy to setup for the average user who wants to setup a pool?

Yeah. I think you just install python then run the setup and start the server.

Of course, there's also a website where you can see the statistics, but there are many bugs and user improvements to be made at the point in the code.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 18, 2014, 01:02:15 am
Is this something that will be easy to setup for the average user who wants to setup a pool?

Yeah. I think you just install python then run the setup and start the server.

Of course, there's also a website where you can see the statistics, but there are many bugs and user improvements to be made at the point in the code.

Actually, you don't even need to run the setup. Just follow the instructions at the start of this post, and you should have your own P2Pool node ready to go in no time. That web is next to go on the list. I hope to make some sort of pleasing method to effectively view P2Pool. May take a few days, but I think it should come out before yam does.

I might ask robonix for help on forging a web design... becaue my design skills are minimal :)
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 18, 2014, 02:08:21 am
That is great news.
I have been thinking more of setting up a pool once I can get a good setup in place to securely and properly host one.

I hear you on the web page building.  I used to be great at it but my skills have eroded over the years. 

Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 18, 2014, 02:37:29 am
That is great news.
I have been thinking more of setting up a pool once I can get a good setup in place to securely and properly host one.

I hear you on the web page building.  I used to be great at it but my skills have eroded over the years.

If you would like to start a pool, it does not hurt to set everything up early. As I make changes, a pool operator could just "git pull" to retrieve all updates.

I hope to have a node explorer like this in the near future: http://scanner.etyd.org/
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 18, 2014, 04:29:59 pm
I want to but I have to get a system setup for it and I am lacking one at the moment.  If I get one I am going to start a pool.  I really like the idea of doing it.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 20, 2014, 04:41:51 am
OK, basic node explorer has been set up, I plan on making it better, obviously. Will update this thread with the news as soon as I am satisfied.

http://mmcexplorer.info/p2pool

How to get listed:

1. Start your P2Pool node, make sure it has connections

2. Make sure you are using the default worker port (8080)

3. Within 5 minutes, your node should be added to the list automatically. Please post on this thread if that is not the case.
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 20, 2014, 03:20:57 pm
The link says it cannot connect.
Are you doing maintenance?
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 21, 2014, 12:45:53 am
The link says it cannot connect.
Are you doing maintenance?

sorry, no, I messed up :) try it again.
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 21, 2014, 06:26:28 am
Cool deal.
Keep up the great work.
Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 21, 2014, 11:32:25 pm
OK, so now the table rows are clickable so the user can go straight to the P2Pool easily. I also fixed a bug which was causing some stress on the server and client.

Next, unification!
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 22, 2014, 03:53:44 am
Any news on yam compatibility version yet ?
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 22, 2014, 03:56:53 am
Any news on yam compatibility version yet ?

still waiting for Stratum support.

Dont worry, I will be posting about it if I get any news :)
Title: Re: P2Pool Beta for Memorycoin
Post by: yvg1900 on March 22, 2014, 08:55:42 am
Any news on yam compatibility version yet ?

still waiting for Stratum support.

Dont worry, I will be posting about it if I get any news :)

P2Pool and stratum support for PTS will come in M7o, and I am pushing it to be released this weekend. There are many small enhancements and improvements, so it is very time consuming, but I formally confirm that P2Pool is on the list for M7o.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 22, 2014, 06:49:44 pm
OK, just added a cheesy navbar to MMCExplorer... :)
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 23, 2014, 05:00:30 am
Could someone test http://103.253.68.72:8080/static/
I'm unable to compile the memoryminner to test against.

Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 23, 2014, 05:14:57 am
Could someone test http://103.253.68.72:8080/static/
I'm unable to compile the memoryminner to test against.

Thanks

Mining seems to work fine, but none of your web stats are appearing. Do you have any connections with the P2Pool network at all? your node should automatically try to connect to memorycoin.biz:2969, and there should be no firewall to block 2969.

Standard output logs would be useful. These are the kinds of bugs I must fix before the mass happens :)

EDIT: Now your P2Pool seems to be alive. You are also listed on the scanner officially.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 23, 2014, 08:15:30 am
Opened firewall in out to port 2969. 
Still try to figure out building the miner.
Stuck at
make: *** No rule to make target `obj/json_spirit_reader.o', needed by `memoryminer'.  Stop.
Guest have to wait for yam version o


Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 23, 2014, 03:00:42 pm
Opened firewall in out to port 2969. 
Still try to figure out building the miner.
Stuck at
make: *** No rule to make target `obj/json_spirit_reader.o', needed by `memoryminer'.  Stop.
Guest have to wait for yam version o

Pull from git again, I think I just fixed your problem, sorry.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 23, 2014, 03:41:16 pm
It worked.

Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 24, 2014, 11:54:58 pm
FYI the p2pool crash with this last log:
https://gist.github.com/anonymous/9752893 (https://gist.github.com/anonymous/9752893)
Same for the minner
Segmentation fault (core dumped)
Title: Re: P2Pool Beta for Memorycoin
Post by: yvg1900 on March 26, 2014, 10:39:05 pm
Is there some P2Pool-based pool that found at least one block?

I need that for testing yam integration.
Title: Re: P2Pool Beta for Memorycoin
Post by: yvg1900 on March 26, 2014, 11:28:02 pm
Is there some P2Pool-based pool that found at least one block?

I need that for testing yam integration.

Do we have at least one functional installation of P2Pool? If so, what is IP/port for stratum connection?

Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 27, 2014, 04:43:09 am
you can look at http://mmcexplorer.info/p2pool (http://mmcexplorer.info/p2pool)
From the payout tab there are somebody who get one block.  But for sure isn't my p2pool.
Still waiting for compatible yam to deploy on all my machine and add more hash to the pool.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 29, 2014, 06:52:49 pm
OK toonces, I am looking at fixing everything now...
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 30, 2014, 02:16:16 am
So far it crashed 3 times. usually after around 24hrs. I put it on a bash loop to auto restart when it crash now :)
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 30, 2014, 03:27:27 am
So far it crashed 3 times. usually after around 24hrs. I put it on a bash loop to auto restart when it crash now :)

yep. I should be pushing a fix by tonight (unless something goes terribly wrong). These are good things to know, so thanks for testing before the crowd.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 30, 2014, 04:11:22 am
Just wondering does the hash rate need to be HPM currently is H/s ? Now testing the memoryminer on 16 core server.  It seems the rate is very slow.  I got 26HPM with yam.
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 30, 2014, 05:35:19 am
A couple things to help get this ready for more people to use it.
1st a guide to what kind of hardware someone will need to run it.
2nd a step by step setup guide.
3rd when you get time a solid GUI for those less technically inclined. 
These things will help spur adoption.
The thing killing P2Pool in Bitcoin right now is lack of those three things.  If you can execute that here it gives MMC a step up.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 30, 2014, 06:00:52 am
Just wondering does the hash rate need to be HPM currently is H/s ? Now testing the memoryminer on 16 core server.  It seems the rate is very slow.  I got 26HPM with yam.

Yes, its a mess. I believe what is shown on the log output is correct (H/m, not H/s), but the web interface is not ready yet. The hash rate is slow without YAM, which we are still waiting for.

A couple things to help get this ready for more people to use it.
1st a guide to what kind of hardware someone will need to run it.
2nd a step by step setup guide.
3rd when you get time a solid GUI for those less technically inclined. 
These things will help spur adoption.
The thing killing P2Pool in Bitcoin right now is lack of those three things.  If you can execute that here it gives MMC a step up.

Unfortunately guides are my big weak point... another officer will have to help me with that.

The GUI would be a great idea though. It could be a launcher used to change the P2Pool settings, which I could whip up if I had the patience to do so (among all the bugs I still need to work with...)
Title: Re: P2Pool Beta for Memorycoin
Post by: ManeBjorn on March 30, 2014, 06:05:45 am
Hopefully one of them will help you out.
Keep up the good work.  It is appreciated.

Just wondering does the hash rate need to be HPM currently is H/s ? Now testing the memoryminer on 16 core server.  It seems the rate is very slow.  I got 26HPM with yam.

Yes, its a mess. I believe what is shown on the log output is correct (H/m, not H/s), but the web interface is not ready yet. The hash rate is slow without YAM, which we are still waiting for.

A couple things to help get this ready for more people to use it.
1st a guide to what kind of hardware someone will need to run it.
2nd a step by step setup guide.
3rd when you get time a solid GUI for those less technically inclined. 
These things will help spur adoption.
The thing killing P2Pool in Bitcoin right now is lack of those three things.  If you can execute that here it gives MMC a step up.

Unfortunately guides are my big weak point... another officer will have to help me with that.

The GUI would be a great idea though. It could be a launcher used to change the P2Pool settings, which I could whip up if I had the patience to do so (among all the bugs I still need to work with...)
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 30, 2014, 06:11:43 am
OK toonces, pull and please let me know if the change has solved the problem. Thanks.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 30, 2014, 09:50:27 am
Done.  Now let see if it last longer.  I will create a guide and automated script like Solo mining MMC using multiple yam workers guide  when  yam is out and the server stabilize.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 30, 2014, 03:13:41 pm
It last about 1:30 hr before it core dump.
here the head and tail of the log.
2014-03-30 12:26:24.363719 p2pool (version 13.4-43-g44c5559-dirty)
2014-03-30 14:06:36.899737 > Failure: twisted.internet.defer.TimeoutError: in _on_discovery_timeout

Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 30, 2014, 04:34:25 pm
It last about 1:30 hr before it core dump.
here the head and tail of the log.
2014-03-30 12:26:24.363719 p2pool (version 13.4-43-g44c5559-dirty)
2014-03-30 14:06:36.899737 > Failure: twisted.internet.defer.TimeoutError: in _on_discovery_timeout

ok maby I got it this time :) Pull again please...
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 31, 2014, 12:09:54 am
Hi KillerByte,

It crash 3 times so far.
Here the logs
https://gist.github.com/anonymous/9882331 (https://gist.github.com/anonymous/9882331)

I'm going to do clean git clone instead of git pull see if it make any difference.

Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 31, 2014, 01:22:14 am
Hi KillerByte,

It crash 3 times so far.
Here the logs
https://gist.github.com/anonymous/9882331 (https://gist.github.com/anonymous/9882331)

I'm going to do clean git clone instead of git pull see if it make any difference.

Hey, new error at least :) OK... examining...
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on March 31, 2014, 11:18:29 am
Hi KillerByte,

Could you also add active miners tab like in http://li625-109.members.linode.com:22550/static/ (http://li625-109.members.linode.com:22550/static/)
Maybe fork from blixnood instead of forrestv it seem to be more up to date.

Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on March 31, 2014, 07:05:33 pm
Great idea. I will make the changes today.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on April 01, 2014, 03:17:43 am
KillerByte,

Look at http://p2pool.jir.dk/dogecoin/ (http://p2pool.jir.dk/dogecoin/) under the tool section.
This make it easier for user to create the miner config.

Maybe this can be added to http://mmcexplorer.info/p2pool (http://mmcexplorer.info/p2pool)

Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 01, 2014, 11:39:20 pm
ok toonces, I have made no progress on finding the solution to your errors.

The first 2... there is no error, it just ends.

The last error... if you provide me with the full stacktrace, it would help me quite a bit!

And looking at the tool selection thing... definitely plan to implement that now, hopefully by the time YAM is all ready. We can do even better: Allow the user to implement his address, and then give a command which the user can copy and paste to connect to the pool.

This may take a little bit of time though, the graphs will a database which I must create and manage, and I have to make sure that MMCExplorer is as reliable as possible so that the graphs look correct.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on April 02, 2014, 01:12:23 am
Do you have a debug version of the p2pool ? I can't find any coredump file. It seems it try to pipe to apport.  I'm running under Ubuntu Server 12.04.4 LTS It seems to crash every 2 hrs with 4 worker pointing at it.  Is the mmcexplorer.info pool working ?  I can just point to it and see if it crash.

Just to point out this is how I start the program under tmux session
Code: [Select]
#!/bin/bash

for i in {1..10}
do
   TIMESTAMP=$(date +%Y%m%d%H%M%S%Z)
   /usr/bin/python /home/ubuntu/p2pool/run_p2pool.py --net memorycoin --fee 1.0 --address MVTEchaqyCuu8RsP5kMYMuTbxRrwZ2jmtQ >> /home/ubuntu/$TIMESTAMP.log 2>&1
   sleep 5
done

Thanks
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 02, 2014, 04:55:51 am
the mmcexplorer.info pool is actually not intended to be mined on, it is just the starting node for the P2Pool scan. You can debug output P2Pool (which would help me if it prints out some signal of what its doing when the error happens) with the --debug option.

You should mine on 162.243.*.*, that is my mining pool (actually it is the XRam Pool). If you crash it, it will help me determine if the crashes are a problem that happens on my server also, since they are very odd.

I cannot mine with my computer at this time.
Title: Re: P2Pool Beta for Memorycoin
Post by: yvg1900 on April 02, 2014, 06:17:32 am
the mmcexplorer.info pool is actually not intended to be mined on, it is just the starting node for the P2Pool scan. You can debug output P2Pool (which would help me if it prints out some signal of what its doing when the error happens) with the --debug option.

You should mine on 162.243.*.*, that is my mining pool (actually it is the XRam Pool). If you crash it, it will help me determine if the crashes are a problem that happens on my server also, since they are very odd.

I cannot mine with my computer at this time.

As far as I understand, mmcexplorer.info P2Pool can be used by miner to discover currently available/running P2Pool instances, isn't it? If so, what is the procedure? Is there some API/link that will get list of current instances in machine readable format (preferably json)?
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on April 02, 2014, 01:21:54 pm
I pointed 4 workers to your p2pool.  Hopefully it will capture some useful information.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 02, 2014, 01:23:51 pm
the mmcexplorer.info pool is actually not intended to be mined on, it is just the starting node for the P2Pool scan. You can debug output P2Pool (which would help me if it prints out some signal of what its doing when the error happens) with the --debug option.

You should mine on 162.243.*.*, that is my mining pool (actually it is the XRam Pool). If you crash it, it will help me determine if the crashes are a problem that happens on my server also, since they are very odd.

I cannot mine with my computer at this time.

As far as I understand, mmcexplorer.info P2Pool can be used by miner to discover currently available/running P2Pool instances, isn't it? If so, what is the procedure? Is there some API/link that will get list of current instances in machine readable format (preferably json)?

Yes, http://mmcexplorer.info:8080/peer_addresses, then you just keep iterating through until you find only duplicate addresses, then you must search each p2pool for local stats and fees, if necessary.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 02, 2014, 01:33:03 pm
I pointed 4 workers to your p2pool.  Hopefully it will capture some useful information.


We will try for 1 day and see if it crashes. Let me know of any downtime so I know when to look.

EDIT: Please pull if you are a prospective pool operator, I updated the root list of nodes so that you can connect to the network, not super important for toonces.

Also, someone is running a P2Pool on an Amazon AWS instance, but does not have any stats to show to MMCExplorer... who is that?

Just in case anyone does not know - you have to mine on your newly created pool a share before its stats show up. After that, you are good.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on April 02, 2014, 11:44:27 pm
KillerByte,

Did http://162.243.241.151:8080/static/ crash ?
the workers crashed several time this past 4 hrs.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 03, 2014, 12:57:39 am
KillerByte,

Did http://162.243.241.151:8080/static/ crash ?
the workers crashed several time this past 4 hrs.

workers crashing is normal, I just had it for testing purposes, not reliability. yvg has informed me he is close to finishing YAM and then there will probably be a big switch. I think yvg may be thinking of autobalancing thing... but maby not.

The pool has not crashed on my end, but we should keep going because I am still not sure.
Title: Re: P2Pool Beta for Memorycoin
Post by: toonces on April 03, 2014, 01:02:09 am
I see that the uptime of your pool decrease from 200+ to only 0.3 hrs.  Did you restart ?
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 03, 2014, 01:25:36 am
I see that the uptime of your pool decrease from 200+ to only 0.3 hrs.  Did you restart ?

I changed the script to provide more logging information... dont know why the uptime is lower now. systemd may have executed an automatic restart. Keeping my eyes peeled.

If it crashes though, I dont have it auto-restarting... so it will be obvious.

EDIT: yep, it crashed. My log was not saved though :( should not be long now. by the time I am back I will be ready for debugging.
Title: Re: P2Pool Beta for Memorycoin
Post by: KillerByte on April 07, 2014, 10:14:39 pm
This thread has been moved to MMC-Square: https://www.mmc-square.com/index.php/topic,32.0.html