Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backup: implement backup compactions after incremental backups #138347

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

kev-cao
Copy link
Contributor

@kev-cao kev-cao commented Jan 6, 2025

This commit supports compacting backups after each incremental backup if the chain has reached a certain threshold.

Epic: none

Release note: None

To support backup compactions, we need to be able to write MVCC keys to
a file sink one key at a time. The current `fileSinkSST` only supports
writing KV export responses, or essentially one span at a time. This
commit adds an implementation that supports writing key by key.

Epic: none

Release note: None
Copy link

blathers-crl bot commented Jan 6, 2025

Your pull request contains more than 1000 changes. It is strongly encouraged to split big PRs into smaller chunks.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@cockroach-teamcity
Copy link
Member

This change is Reviewable

This commit supports compacting backups after each incremental backup if
the chain has reached a certain threshold.

Epic: none

Release note: None
@kev-cao kev-cao force-pushed the backup/compaction branch from 98dab3e to 8c7d261 Compare January 6, 2025 21:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants