Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

experimental: Retry manager with mpsc #318

Draft
wants to merge 46 commits into
base: main
Choose a base branch
from
Draft

experimental: Retry manager with mpsc #318

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
416ef8d
create a retry manager struct
tipogi Dec 10, 2024
9506134
prepare the WatcherTest for RetryManager component
tipogi Dec 11, 2024
aa736b4
Merge branch 'main' into feat/retry-manager
tipogi Dec 11, 2024
04b79ff
start catching the failed events
tipogi Dec 11, 2024
cdac5fd
minor changes
tipogi Dec 12, 2024
2c9b800
merge main
tipogi Dec 13, 2024
9778d60
Merge branch 'main' into feat/retry-manager
tipogi Dec 18, 2024
a9ba375
Add TODO comment
tipogi Dec 18, 2024
b7832c5
deps: bump axum to 0.8.1 (#276)
SHAcollision Jan 7, 2025
2bd53cf
deps: bump serde_json from 1.0.134 to 1.0.135 (#281)
dependabot[bot] Jan 7, 2025
1239256
merge main
tipogi Jan 9, 2025
afa71d9
merge main
tipogi Jan 9, 2025
cade794
error control in PUT events for RetryManager and add tag related inte…
tipogi Jan 13, 2025
bd6eeb2
refactor RetryEvent and crete new folder for RetryManager
tipogi Jan 14, 2025
f2dba56
replace the HashMap structure with a JSON-based implementation
tipogi Jan 14, 2025
9abbe4e
Change the dependencies format: Instead of a URI, add RetryManager in…
tipogi Jan 14, 2025
0efe196
add more integration tests
tipogi Jan 14, 2025
4487e36
improve graph operation state enum
tipogi Jan 15, 2025
2a175a3
retry queue with DEL events, testing with bookmarks
tipogi Jan 15, 2025
155d7e3
Add error control for DEL events when the index fail
tipogi Jan 20, 2025
02e7de3
merge from main
tipogi Jan 20, 2025
e26935f
log all errors related to event processing
tipogi Jan 21, 2025
02c9d60
Create a better error handling while we analyze the event line
tipogi Jan 22, 2025
d46e9b0
minor changes
tipogi Jan 22, 2025
22daacd
add review changes
tipogi Jan 28, 2025
dfc82c6
Merge branch 'main' into feat/retry-manager
tipogi Jan 28, 2025
2dd10b8
fix error
tipogi Jan 28, 2025
d3150f5
improve pubky connector
tipogi Jan 28, 2025
53c74df
fix test errors
tipogi Jan 28, 2025
a453f16
test the retry mananger tests without sleep
tipogi Jan 29, 2025
f27ddd6
delete the tokio::sleep and add a util
tipogi Jan 29, 2025
71c9d89
review fixes II
tipogi Jan 29, 2025
bfdc0ce
minor changes II
tipogi Jan 30, 2025
4888a03
improve channel stability between EventProcessor and RetryManager
tipogi Jan 31, 2025
2c3ffad
merge main
tipogi Jan 31, 2025
e2faab0
Init use specs parser
SHAcollision Feb 3, 2025
6ee9c8e
Use PubkyAppObject importer
SHAcollision Feb 3, 2025
1120617
Fix re-introduce debug logs
SHAcollision Feb 3, 2025
1d47432
Merge pull request #311 from pubky/feat/use-specs-parser
SHAcollision Feb 3, 2025
6c9e9b8
Send invalid line error on unknown parsed resource
SHAcollision Feb 3, 2025
d0a3607
Use uri parser for generate_index_key
SHAcollision Feb 3, 2025
8405c53
Use resource display to generate index key
SHAcollision Feb 3, 2025
6cc28e0
Remove hardcoded index keys
SHAcollision Feb 3, 2025
25efee9
last changes before merge
tipogi Feb 4, 2025
3297572
Merge branch 'main' into feat/retry-manager
tipogi Feb 4, 2025
b64082a
fix gh action integration test command
tipogi Feb 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .env-sample
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ SERVER_PORT=8080

# Watcher
TESTNET=true
# Tesnet bootstrap IP:PORT
# Testnet bootstrap IP:PORT
BOOTSTRAP=127.0.0.1:6881
# Homeserver ID. Needed for event streams.
HOMESERVER=
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ jobs:
sleep 10 # Give the service a moment to start

- name: Run integration tests
run: cargo nextest run -no-fail-fast
run: cargo nextest run --no-fail-fast

- name: Show service logs if tests fail
if: failure()
Expand Down
92 changes: 46 additions & 46 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ bytes = "1.9.0" # Enforce this version as Pubky and Axum conflict v1.7.1 vs v1.9
pkarr = { git = "https://github.com/pubky/pkarr", branch = "v3-rc1", package = "pkarr" }
mainline = { git = "https://github.com/pubky/mainline", branch = "v5-rc1", default-features = false }
pubky = { git = "https://github.com/pubky/pubky", branch = "v0.4.0-rc1" }
pubky-app-specs = { git = "https://github.com/pubky/pubky-app-specs", features = [
pubky-app-specs = { git = "https://github.com/pubky/pubky-app-specs", branch = "feat/uri-parser", features = [
"openapi",
] }
tokio = { version = "1.43.0", features = ["full"] }
Expand Down
Loading
Loading