Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utilizing a separate persistent datastore #44

Open
2 of 7 tasks
laurensdeb opened this issue May 4, 2021 · 0 comments
Open
2 of 7 tasks

Utilizing a separate persistent datastore #44

laurensdeb opened this issue May 4, 2021 · 0 comments
Labels
enhancement New feature or request long-term

Comments

@laurensdeb
Copy link
Collaborator

laurensdeb commented May 4, 2021

Using a persistent MongoDB or PostgreSQL database we could retain state on the information already parsed by the Parser as well as decouple the logic of our view and parsing in the long term.

  • Investigate solutions for a datastore: Do we utilize a hosted service (MongoDB Atlas, Firebase, Heroku Postgres) or bootstrap something on a VPS?
  • Write persisting logic for the current parser using an ORM
  • Make the build step configurable to either pull data from the database for a certain session or to perform parsing and update the database as a whole.

Future steps:

  • How to handle schema changes?
  • How do we optimize builds to take advantage of these new features
  • Strip the strict view code from the parsing & build logic and split this into a separate module
  • Strip the model code from the parsing & build logic and split this into a separate module
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request long-term
Projects
None yet
Development

No branches or pull requests

1 participant