Update to 1.1.0 #89
Merged
Update to 1.1.0 #89
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Refactored the PDFProcessor class to accept a LangChainWrapper object for initializing retriever and embeddings. Also added logging configuration using Python's logging module for better error handling and information tracking.
Signed-off-by: Daemon <[email protected]>
Updated the project version to 1.0.223 in pyproject.toml. Additionally, restructured the LangChain/Retrieval_Augmented_Generation module by removing PyPDFLoader and introducing a new directory 'pdf_only' containing relevant files for PDF handling and retrieval augmented generation. The commit also includes changes to the test_query_local_docs.py file to mock dependencies and update tests for the RAG chain invocation, document loading, and document embedding.
Daethyra
added
Documentation
This comment was marked as outdated.
This comment was marked as outdated.
- Fixed some broken code - Removed unuseful modules - Deleted a useless prompt - Rearranged prompts_MASTER file for sensibility
- Untested cell in src/llm_utilikit/LangChain/using_tools/generate_and_caption.ipynb
This commit removes deprecated files and dependencies related to LangChain's RAG with Agents, including unused Python scripts, READMEs, environment templates, and requirements.
new file: src/llm_utilikit/LangChain/chatbots/streamlit/requirements.txt new file: src/llm_utilikit/LangChain/chatbots/streamlit/st_chat.py new file: src/llm_utilikit/LangChain/chatbots/streamlit/st_with_memory.py renamed: src/llm_utilikit/LangChain/Code Snippets/bufferwindow_memory.py -> src/llm_utilikit/LangChain/code-snippets/bufferwindow_memory.py renamed: src/llm_utilikit/LangChain/Code Snippets/chatopenai.py -> src/llm_utilikit/LangChain/code-snippets/chatopenai.py renamed: src/llm_utilikit/LangChain/Code Snippets/multi_vector_query_retrieval.py -> src/llm_utilikit/LangChain/code-snippets/multi_vector_query_retrieval.py new file: src/llm_utilikit/LangChain/rag-with-agents/README.md new file: src/llm_utilikit/LangChain/rag-with-agents/create_custom_rag_agent.py new file: src/llm_utilikit/LangChain/rag-with-agents/directoryloader/.env.template new file: src/llm_utilikit/LangChain/rag-with-agents/directoryloader/README.md renamed: src/llm_utilikit/open_ai/embeddings_pinecone/__init__.py -> src/llm_utilikit/LangChain/rag-with-agents/directoryloader/__init__.py new file: src/llm_utilikit/LangChain/rag-with-agents/directoryloader/qa_local_docs.py new file: src/llm_utilikit/LangChain/rag-with-agents/directoryloader/run_qa_local_docs.py new file: src/llm_utilikit/LangChain/rag-with-agents/pdf_only/README.md new file: src/llm_utilikit/LangChain/rag-with-agents/pdf_only/__init__.py new file: src/llm_utilikit/LangChain/rag-with-agents/pdf_only/query_local_docs.py new file: src/llm_utilikit/LangChain/rag-with-agents/pdf_only/requirements.txt new file: src/llm_utilikit/LangChain/rag-with-agents/streamlit_app.py new file: src/llm_utilikit/LangChain/rag/pinecone/__init__.py new file: src/llm_utilikit/LangChain/rag/pinecone/application.py new file: src/llm_utilikit/LangChain/rag/pinecone/documentservice.py new file: src/llm_utilikit/LangChain/rag/pinecone/main.py new file: src/llm_utilikit/LangChain/rag/pinecone/vectorstoreservice.py modified: src/llm_utilikit/LangChain/using_tools/generate_and_caption.ipynb deleted: src/llm_utilikit/open_ai/API Documentation/API Reference - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Chat completion - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Embeddings - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Error codes - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Fine-tuning - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Rate Limits - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Safety best practices - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Speech to text - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/API Documentation/Text completion - OpenAI API.pdf deleted: src/llm_utilikit/open_ai/code_snippets/local_gpt4allapi_code_completion.py deleted: src/llm_utilikit/open_ai/embeddings_pinecone/.env.template deleted: src/llm_utilikit/open_ai/embeddings_pinecone/README.md deleted: src/llm_utilikit/open_ai/embeddings_pinecone/pinembed.py deleted: src/llm_utilikit/open_ai/embeddings_pinecone/requirements.txt
Signed-off-by: Daemon <[email protected]>
Updated README.md to remove unnecessary content and corrected formatting in prompt-cheatsheet.md. Renamed prompts_MASTER.md to docs/prompts_MASTER.md for better organization. This commit enhances the clarity and organization of the project's documentation and prompt files, ensuring a more user-friendly experience and improved readability.
Daethyra
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
query_local_docs.pycode refactorization #88- More of this work to be done when i start working on outdated logic in `src/llm_utilikit/hugging_face/*` & `src/llm_utilikit/open_ai/*`