Author Topic: API Node Latency Map  (Read 598 times)

0 Members and 1 Guest are viewing this topic.

Offline litepresence

API Node Latency Map
« on: December 07, 2018, 10:30:21 pm »
for data you go here:

https://api.jsonbin.io/b/5c06e4f71deea01014bd4261/latest#Bitshares_Latency

This jsonbin api is at a stationary location.

I update the latency info hourly via python script; I'm on east coast US.

at the link you will find json dictionary with keys:

['GEO', 'COUNT', 'PING', 'URLS', 'LIVE', 'SOURCE_CODE', 'MAP_URL', 'MISSION', 'UTC', 'UNIX', 'OWNER', 'LOCATION', 'UNIVERSE']

UNIVERSE is all known bitshares public api nodes mentioned in various github projects; I suspect I have the largest known list of bitshares public api domains

URLS are github urls where node lists can be found; this tool does not contain a list of nodes.  Instead it goes to many different repos on github (such as bitshares, cryptobridge, rudex) etc.  where people have configuration files with lists of nodes; if they update their repo with new nodes, the script finds them with web scraping methods

LIVE is a list of tested nodes that respond within 10 seconds and have a head block number that is not stale. 

PING is list of tuples of ping time for each LIVE node

GEO is geo location data (country, city, longitude, latitude) for each LIVE node as provided by ip-api.com or ipinfo.io

COUNT is number of live nodes vs number of nodes in universe

SOURCE_CODE is my github were you can get this tool and run it yourself to produce your own web hosted latency map in distributed fashion.  The latency script will also give you information as to why each down node failed to connect.  A full report looks like this:

https://pastebin.com/JL4DZzwY

You can also pick up copy of metaNODE and ExtinctionEvent while you're there :D

UNIX and UTC are time stamp when this jsonbin was last updated

MAP_URL is a link to a visual image of the data on the jsonbin;
the map url will change every hour!


it will be something like:
https://vgy.me/dgCE1C.png


and look like one frame of this gif





source code is here, WTFPL:

https://github.com/litepresence/extinction-event/blob/master/EV/bitshares-latency.py

todo list... upload 24hr animations instead of still images


thanks to free and easy to use api services that make this project is possible:

ip-api.com
jsonbin.io
vgy.me


« Last Edit: December 08, 2018, 08:16:24 pm by litepresence »

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12866
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
Re: API Node Latency Map
« Reply #1 on: December 08, 2018, 11:09:58 am »
Cool.
Give BitShares a try! Use the http://testnet.bitshares.eu provided by http://bitshares.eu powered by ChainSquad GmbH

Offline litepresence

Re: API Node Latency Map
« Reply #2 on: December 13, 2018, 01:05:42 am »
updated repo

- removed whitespace from uploaded images for easier incorporation into user websites
- uploaded basemap.png to repo
- added list of seed nodes to jsonbin under key 'SEEDS' with data ('ip', 'ping', 'geolocation')
- plotting seed nodes on top with yellow dots
- added UTC timestamp to images
- removed misleading green dots in africa from the lens flare in the base map

new sample:




this should satisfy most requirements of issue 1348

https://github.com/bitshares/bitshares-core/issues/1348

« Last Edit: December 13, 2018, 01:12:19 am by litepresence »

Offline Customminer

  • Hero Member
  • *****
  • Posts: 653
  • Bitshares FTW!
    • View Profile
  • GitHub: grctest
Re: API Node Latency Map
« Reply #3 on: December 18, 2018, 11:03:50 am »
What does the large pulsating circle around geographical points indicate? Activity?

Offline litepresence

Re: API Node Latency Map
« Reply #4 on: February 14, 2019, 05:17:34 pm »
What does the large pulsating circle around geographical points indicate? Activity?

the bigger the circle the faster the response time to USA east coast

Offline litepresence

Re: API Node Latency Map
« Reply #5 on: February 14, 2019, 07:08:50 pm »
You can still use this script on your own machine, but I am no longer keeping this live updated; my internet bandwidth is very limited.  Please contact me on telegram @litepresence if you would like to keep a public version alive and I'll point this thread at it.

my github has recently been updated to newer version, you no longer need the basemap, the script will aquire it externally from imgur

Offline iamredbar

Re: API Node Latency Map
« Reply #6 on: February 15, 2019, 02:27:18 am »
+5%
BitShares Testnet Witness