Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove ReportsProcessed DO #433

Merged
merged 3 commits into from
Dec 4, 2023
Merged

Remove ReportsProcessed DO #433

merged 3 commits into from
Dec 4, 2023

Conversation

mendess
Copy link
Collaborator

@mendess mendess commented Nov 22, 2023

No description provided.

@mendess mendess self-assigned this Nov 22, 2023
@mendess mendess force-pushed the mendess/reports-processed branch 2 times, most recently from a9aafd8 to 1066290 Compare November 22, 2023 11:43
Copy link
Contributor

@cjpatton cjpatton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great to see that we can basically rip this out. However I think I see at least one regression: The Leader no longer checks for replays in time to reject the reports during an aggregation job.

Also, and this is somewhat separate so feel free to punt: The ReportsProcessed DO instances are self-cleaning in the sense that, on creation, an alarm is set that deletes the instance some time later. Now would be a good time to implement this for AggregateStore as well, since we mainly just need to copy-paste the code from the reports_processed module to aggregate_store.

daphne_worker/src/roles/aggregator.rs Show resolved Hide resolved
@mendess mendess force-pushed the mendess/reports-processed branch 2 times, most recently from 30f35ab to f6a83f3 Compare November 24, 2023 18:04
Copy link
Contributor

@cjpatton cjpatton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good! One more question about the code itself, other comments are just related to documentation.

daphne/src/roles/aggregator.rs Outdated Show resolved Hide resolved
daphne/src/roles/leader.rs Outdated Show resolved Hide resolved
daphne/src/roles/leader.rs Outdated Show resolved Hide resolved
daphne/src/roles/mod.rs Outdated Show resolved Hide resolved
daphne/src/testing.rs Show resolved Hide resolved
daphne_worker/src/durable/reports_processed.rs Outdated Show resolved Hide resolved
daphne_worker/src/roles/aggregator.rs Outdated Show resolved Hide resolved
@mendess mendess force-pushed the mendess/reports-processed branch from f6a83f3 to 9571ad1 Compare November 29, 2023 16:07
@mendess mendess requested a review from cjpatton November 29, 2023 16:08
@mendess mendess force-pushed the mendess/reports-processed branch from 9571ad1 to 15f5930 Compare November 29, 2023 16:27
Copy link
Contributor

@cjpatton cjpatton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great overall, but I think this needs a few minor changes. I've also bumped some comments that we missed in the previous round.

Also, I think we should delete this outdated comment we noticed on Tuesday (this caused some confusion about if/when the Leader needs to check for replays): https://github.com/cloudflare/daphne/blob/main/daphne_worker/src/roles/leader.rs#L105-L109

daphne/src/roles/aggregator.rs Outdated Show resolved Hide resolved
daphne/src/roles/aggregator.rs Outdated Show resolved Hide resolved
daphne/src/roles/aggregator.rs Show resolved Hide resolved
daphne/src/roles/helper.rs Outdated Show resolved Hide resolved
daphne/src/roles/helper.rs Show resolved Hide resolved
daphne/src/roles/leader.rs Outdated Show resolved Hide resolved
daphne/src/roles/leader.rs Show resolved Hide resolved
daphne/src/roles/mod.rs Outdated Show resolved Hide resolved
daphne/src/testing.rs Show resolved Hide resolved
daphne_worker/src/config.rs Show resolved Hide resolved
@mendess mendess force-pushed the mendess/reports-processed branch from d4d378c to 8231f9e Compare November 30, 2023 18:07
Copy link
Contributor

@cjpatton cjpatton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🦆 great work

@mendess mendess force-pushed the mendess/reports-processed branch from 8231f9e to ec84c0b Compare December 4, 2023 10:50
@mendess mendess merged commit b107a07 into main Dec 4, 2023
4 checks passed
@mendess mendess deleted the mendess/reports-processed branch December 4, 2023 11:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants