Overhauled Demo and assets for new Features like Vector Search, FMAPIs, DBRX, etc. #10
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Updated the Data Prep with LangChain notebook to use Vector Search. Updated the util/install-prep-libraries.py notebook accordingly. This worked as of 14.3 LTS ML.
Updated the QA Chain to be a RetrieverQA base class to use Vector Search as the retreiver
Updated 03 to register models to UC. I then updated the deployment to deploy from models in UC to a model serving slot. I removed extra code that was no longer applicable due ot the shift to UC. For 04, I updated syntax for instantiating the model using langchain and the qa_chain logic. I also updated langchain libraries to the updated version due to changes with underlying dependency imports like SQL_Alchemy. There are temporary changes due to local testing like secrets and hard coded database names.
Updated dependency versions and respective files for installation throughout the demo. Also updated some markdown to reference Vector Search and UC Volunmes.
Updated the text in the introduction and README for: DBRX, Vector Search, newer DBR, etc.
Updated the dependency installation script to reduce the number of required packages. Data Prep script was updated with the newer components like BGE-Large, Vector Search, etc. Included new variables naming conventions as well as checks for empty lists returned from the Vector Search client.
- Updated notebooks with new parameters, dependencies, and syntax - Updated License and Notice for 2024 - Updated README with new components and dependencies - Moved GPU Serving notebook to the util folder
…dependencies, parameters, and documentation - Updated notebooks with new parameters, dependencies, and syntax - Updated License and Notice for 2024 - Updated README with new components and dependencies - Moved GPU Serving notebook to the util folder
Updated notebooks with new parameters, dependencies, and syntax Updated License and Notice for 2024 Updated README with new components and dependencies Vector search UC volumes Foundation models API DBRX Dependencies
|
|
|
@kermany and @jamesrmccall , I know we are coming off of DAIS so happy to hop on a call to discuss this PR if needed. Thank you! |
|
@jamesrmccall @kermany , are we clear to merge this and delete the deployment notebook, or should I reopen the PR? Thank you! |
calreynolds
merged commit 404e075
into
databricks-industry-solutions:main
1 of 2 checks passed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overhauled notebooks and assets to include:
Also: