Release 2.2.0

Release 2.2.0

This release adds support for the Ethereum discv5 DHT and experimental support for discv4. It also adds network configuration to crawl the Celestia network.

What's Changed

• Ethereum Support by @dennis-tra in #42
• Celestia Mainnet Support by @dennis-tra in #45
• Ethereum Consensus Layer Monitoring by @dennis-tra in #47
• Downgrade libp2p to support /quic by @dennis-tra in #48
• Add Ethereum Execution Layer support (discv4) by @dennis-tra in #50
• Discv4: request agent information and capabilities by @dennis-tra in #51
• query bootstrap peers from the database to start a crawl by @dennis-tra in #52
• fix: store reported discv5 listen maddrs in the DB by @guillaumemichel in #54
• discv5: only store crawl error if no query succeeded by @guillaumemichel in #55
• fix: crawl_error detection by @guillaumemichel in #57
• feat: store additional ENR fields by @dennis-tra in #58

New Contributors

• @guillaumemichel made their first contribution in #54

Full Changelog: 2.1.2...2.2.0

Detailed Changelog

• d8d051c Add Ethereum Consensus Layer Support (#42)
• 4573f54 Add go releaser github action
• 9a62827 Update Goldberg bootstrap configuration
• e366e6d Update README
• 294ed92 Update README.md
• 1ef6f92 Update README.md
• 6f4760f Update README.md
• 4826287 add celestia Mainnet Support (#45)
• b50f7bf add command line option to log full error
• e7a845b add discv4 ethereum execution layer support
• 15c8dfd add goreleaser config
• 7a2d780 add new known errors
• e610e55 add relay connection error case
• 78dfa48 add snap capability to devp2p client
• 459288c add timeout to monitor dialing task
• 3c7583b add: YouTube video to readme
• 74dbe6e add: go test status badge
• 4b16c1b add: health endpoint and health check
• 0bca573 add: keep ENR crawl option
• 7bc88b3 add: new known error
• eceaae7 add: version column to crawls table
• b4b8536 addressing review
• 450725a allow transient and non-direct connections
• cca3cb0 bump: Dockerfile golang basea image
• 83ab980 bump: go-libp2p to 0.28.3
• 60d95ef change: go test workflow postgres port
• 24b7988 decrease global dial timeout to 10s
• 19ea797 discv4: add devp2p package
• 523613b discv4: add peer identification logic
• 5c516b8 discv4: decrease retry timeout
• 8bbbbca discv5: improve address sanitization
• 52500d1 distinguish between goldberg LC and FN
• a3ffd2f downgrade Dockerfile base image Go version
• c7f41cf downgrade GitHub-Actions Go version
• 1519259 downgrade Identify call failure log message
• 540bdfa downgrade go-libp2p to support /quic transport
• 9fa221c downgrade goleak to work with go1.19
• 845988c enable CGO in Dockerfile
• ce78e3c extend known error strings
• bc7ffb2 feat: add Avail Goldberg network
• ce55b29 feat: add holesky testnet
• 8b6aa61 feat: discv4 prefix map generation
• 1f6a210 feat: enable circuit relay transport
• 4fddad9 feat: ethereum consensus layer monitoring
• 904cb5d feat: store additional ENR fields
• 27b6127 fix: Makefile up down migration command
• df87a4f fix: NPE as metric providers are not set in monitor engine config
• d9d77c7 fix: attnets ENR parsing
• 55a4a2e fix: crawl_error detection (#57)
• 55ec088 fix: database test
• 0e6c5f7 fix: discvx imports
• f74507c fix: makefile nebula port
• cdaf72e fix: maxmind db loading error handling
• d84e97f fix: migration 26 replace calc max failed visits
• 242311a fix: return crawl error if unhandled
• cea10fe fix: store connection and not crawl errors
• d905f8e fix: track errorbits even after retries are exceeded
• c6aed4e fix: udger db database driver
• b4fedb5 fix: upper bound check
• 32836e1 fixed successful query detection
• e201684 go mod tidy
• 4c7f402 handle additional timeout error
• b8c6c5a handle immediately closed connection
• e4aaa92 ignore maxmind database files
• 55d0637 import mplex separately
• 08a72fa improve ethereum crawling
• 87d1c40 improve libp2p retry logic
• 0578b5a increase: disv5 timeout
• 22f4959 init as many libp2p hosts as available CPU cores
• 2aeec75 keep track of unknown crawl errors
• 7eeabc2 let Nebula listen over TCP/UDP
• 6682e88 libp2p: rework retry logic
• 65b985a log: number of queried peers
• dc8f5e6 monitor: log if there are no open sessions
• 2eb99f5 prevent dial backoffs in monitoring mode
• 1022437 query bootstrap peers from the database to start a crawl
• 5773da0 refactor: code orgranisation
• b20ff79 refactor: use opentelemetry
• 8e34dc4 remove debug log message
• b7cb9ae remove: .git from .dockerignore
• 665df75 remove: Biryani configuration
• 5dab308 remove: codeql analysis
• 7e9ce0b remove: deployment folder
• 1230c29 remove: goreleaser before hooks
• 3b8ad31 remove: maxmind database embeddings
• 9b1dcac remove: reporting and analysis code
• c9c4546 removed discv5 crawl error if 1 query succeeds
• 090de44 set pi.maddrs from peerstore addresses
• 1063edb update Dockerfile
• 90f44db update multiaddress resolution logic
• 5d53400 update: GitHub action go version
• c0593c0 update: Goldberg configuration
• db9d63c update: github actions
• f252f81 use original go-ethereum discv4 discv5 implementations
• e0c5705 use root config struct for log configuration