Skip to content

Conversation

@dennis-tra
Copy link
Owner

This PR adds preliminary support for sourcing the peers to crawl via GossipSub Peer Exchange.

Upon connection to a peer we wait until the remote opens a gossipsub stream to us. Then we try to graft the remote peer and if that peer is already at capacity for a given topic it'll prune us while providing additional peers to connect to. The latter bit is the GossipSub Peer Exchange (PX) functionality.

For the Filecoin network (the only one that we know of that has this feature enabled) this means:

PX Disabled: crawlDuration=31.395986409s crawledPeers=684
PX Enabled:  crawlDuration=51.537761043s crawledPeers=1015

This means we find ~48% (!) more peers enabling gossipsub PX.

@dennis-tra dennis-tra merged commit 7ffddbd into main Apr 16, 2025
1 check passed
@dennis-tra dennis-tra deleted the gossipsub-px branch April 16, 2025 11:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants