Skip to content

Commit

Permalink
local_llm_fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
@rounak610
rounak610 committed Jan 12, 2024
1 parent 2178854 commit 4daf18a
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions config_template.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -122,3 +122,4 @@ ENGINE_ID: "stable-diffusion-xl-beta-v2-2-2"
## To use Qdrant for vector store
#QDRANT_HOST_NAME: YOUR_QDRANT_HOST_NAME
#QDRANT_PORT: YOUR_QDRANT_PORT
GPU_LAYERS: GPU LAYERS THAT YOU WANT TO OFFLOAD TO THE GPU WHILE USING LOCAL LLMS

0 comments on commit 4daf18a

Please sign in to comment.