Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Separate Vector Database Build Pipeline #2

Open
Tiger767 opened this issue Nov 18, 2024 · 0 comments
Open

Separate Vector Database Build Pipeline #2

Tiger767 opened this issue Nov 18, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Tiger767
Copy link
Collaborator

The vector database build pipeline can take several minutes to process causing problems with first chat interface (Chainlit) start up. Furthermore, separating the database build pipeline from the user query processing pipeline will simplify the application and will make possible future improvements.
@Tiger767 Tiger767 self-assigned this Nov 18, 2024
@Tiger767 Tiger767 added the enhancement New feature or request label Nov 18, 2024
@Tiger767 Tiger767 mentioned this issue Jan 10, 2025
Merged
Tiger767 added a commit that referenced this issue Jan 10, 2025
@Tiger767
Add stress test script and server setup info (#6)
f243572 
Update several different aspects across the chatbot:

- Add a stress test script and fix problems found through such testing
  - Fix async problem with Llamaindex
  - Improve async tracking database management by converting from SQLite to MongoDB
- Add server setup information
- Add script that handles environment setup and startup of RAG Chatbot
- Add export script to obtain CSV of tracking data in the MongoDB
- Add WIP script for #2
@Tiger767 Tiger767 removed their assignment Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Tiger767