Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow export of all records #890

Open
afred opened this issue Jun 7, 2024 · 0 comments
Open

Allow export of all records #890

afred opened this issue Jun 7, 2024 · 0 comments

Comments

@afred
Copy link
Contributor

afred commented Jun 7, 2024

User story

As a repository administrator
I can export the entire repository
in order to

  • do backups, systematically or ad hoc
  • use large exports as inputs to other tools systems
    • publish to AAPB
    • input to CLAMS, Fix-IT, future systems
      without getting gateway timeout errors.

Background

Currently there are some practical limitations on exporting large record sets that are not being handled very well. Ideally. we want our export/publish workflow to be able to scale up, and be reasonably performant up to the size of the entire repository and beyond.

Also created a smaller scope ticket (#891) to deal with the unhandled error for when exports/pushes are too large. If we don't want to tackle the scope of this ticket yet, then maybe start there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant