Skip to content

A working example of RAG using LLama 2 70b and Llama Index

Notifications You must be signed in to change notification settings

nicknochnack/Llama2RAG

Folders and files

NameName
Last commit message
Last commit date

Latest commit

74e1ad4 Β· Aug 18, 2023

History

2 Commits
Aug 18, 2023
Aug 18, 2023
Aug 18, 2023
Aug 18, 2023

Repository files navigation

Building LLama Banker

Doing RAG for Finance using LLama2. Highly recommend you run this in a GPU accelerated environment. I used a A100-80GB GPU on Runpod for the video!

See it live and in action πŸ“Ί

Tutorial

Startup πŸš€

  1. Clone this repo git clone https://github.com/nicknochnack/Llama2RAG
  2. Go into the directory cd Llama2RAG
  3. Startup jupyter by running jupyter lab in a terminal or command prompt
  4. Update the auth_token variable in the notebook.
  5. Hit Ctrl + Enter to run through the notebook!
  6. Go back to my YouTube channel and like and subscribe πŸ˜‰...no seriously...please! lol
  7. If you want to start up the streamlit app run streamlit run app.py (make sure you update your auth token in there as well!)

Other References πŸ”—

-Llama 2 70b Chat Model Card:hugging face model card on the model used for the video.

-Llama Index Doco:sick library used for RAG.

Who, When, Why?

πŸ‘¨πŸΎβ€πŸ’» Author: Nick Renotte
πŸ“… Version: 1.x
πŸ“œ License: This project is licensed under the MIT license. Feel free to use it, just don't do bad things with it.

About

A working example of RAG using LLama 2 70b and Llama Index

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published