Nebula

A network agnostic DHT crawler and monitor. The crawler connects to DHT bootstrappers and then recursively follows all entries in their k-buckets until all peers have been visited. The crawler supports the following networks:

• IPFS - Amino DHT
• Ethereum - Consensus Layer
• Ethereum - Testnet Holesky (alpha)
• Filecoin
• Polkadot
• Kusama
• Rococo
• Westend
• Celestia - Mainnet
• Celestia - Arabica
• Celestia - Mocha

The crawler is powering critical IPFS Amino DHT KPIs, used for Weekly IPFS Reports as well as for many metrics on probelab.io. The main branch will contain the latest changes and should not be considered stable. The latest stable release that is production ready is version 2.2.0. The gathered numbers about the IPFS Amino DHT network are in line with existing data like from the wiberlin/ipfs-crawler. Their crawler also powers a dashboard which can be found here. Numbers of the Ethereum Consensus Layer do not match existing numbers from other teams like MigaLabs' as can be seen on their dashboard. However, this seems to be because of different ways to aggregate and group peers in the network.