Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Properly handle multi-query retrieval #1067

Draft
wants to merge 567 commits into
base: main
Choose a base branch
from

Conversation

arn-tru
Copy link
Contributor

@arn-tru arn-tru commented Apr 10, 2024

  • Added missing import in one of the notebooks

joshreini1 and others added 30 commits December 12, 2023 15:32
* Update 2_honest_rag.ipynb

* Update 3_harmless_eval.ipynb

* Update 4_harmless_rag.ipynb

* Update 5_helpful_eval.ipynb

* Update 2_honest_rag.ipynb
* basic langchain provider implementation

* langchain provider, minor refactor

* update docstring

---------

Co-authored-by: Josh Reini <[email protected]>
* change relative links to hardcoded links in docs

* hardlink contributions guide

* update readmes, contributing
* first pass at migrating to pydantic v2, not ready

* more fixes

* disable protected namespace warning

* cleanup setup

* revert Any types

* fixing schema and serial types

* fixing more v1 -> v2 pydantic changes

* working trubot

* patching serialization and loading issues

* remove unneeded

* remove uneeded

* format

* pydantic update in reqs file

* test fixes

* revert explain changes

* remove unneeded

* fixing unit tests

---------

Co-authored-by: Josh Reini <[email protected]>
* adding migration from prior versions and a dump of current version database

* few fixes

* more fixes

* moar

* add pip list to pipeline

* activate

* fix pipeline again

* dont use class info unless needed

* deserialize

* fix type annotation of ground_truth

* update SimpleWebPageReader import

* notes

* missed some import changes

* more fixes

* type annot

* more fixes

* more fixes

* add Feedback info instead of FeedbackDefinition info
* update nb tagged versions

* bump py script quickstarts
* update nb tagged versions

* bump py script quickstarts

* remove cohere provider, fix typo in hf api docs

* more cohere removes
* better messages

* better dummy

* remove unused streamlit_javascript requirement
#690)

* extra query_str from query bundle as main input

* add test to dev_notebook

* notes for dev notebook
* add langchain rag instrumentation

* remove unneeded
* bump versions in quickstarts

* bump version

* remove openai references in function definitions page
* bump versions in quickstarts

* bump version

* remove openai references in function definitions page

* gemini example

* headers

* second example: semantic evals

* updates, add rag triad

* update top header
…#696)

* add aliases for selectors for main method args and main method return

* break down

* refine

---------

Co-authored-by: Josh Reini <[email protected]>
* exposed AzureOpenAI provider

* added docs

* Update CONTRIBUTING.md

* typo in mkdocs.yml

---------

Co-authored-by: Josh Reini <[email protected]>
* first

* typos

* typehint
* import llama only if needed

* use optional imports instead

---------

Co-authored-by: Piotr Mardziel <[email protected]>
* fix

* typo

* don't print external if internal is available
Co-authored-by: Piotr Mardziel <[email protected]>
* adjust docstring for select_context

* langchain select_context, update quickstarts

* undo app name change

* remove dev cell

* generalized langchain select_context (#711)

* generalized langchain select_context

* typo

* typo in string

* update langchain example to pass app in select_context

---------

Co-authored-by: Josh Reini <[email protected]>

* comments, clarity updates to quickstarts

* add lib-independent select_context

* update lc li quickstarts

---------

Co-authored-by: Piotr Mardziel <[email protected]>
* add optional

* bug class_info fix
* update configs

* bugfix

* dont add class info to dicts
* Fix correctness prompt

Fixes #718

* Update base.py
arn-tru and others added 29 commits April 17, 2024 09:52
* release test fixes (#1078) (#1080)

* fixes

* one more

* release test fixes (#1078) (#1081)

* fixes

* one more

* Piotrm/release fixes 002 (#1082)

* fixes

* one more

---------

Co-authored-by: Piotr Mardziel <[email protected]>
* add maintainers and releases files

* add maintainers and releases to docs

* add more maintainers and github names

* more maintainers

* add release process info

* releases text
* fix expositional example colab links

* fix notebook description of test cases
* first

* delete instructions

* static delete singleton instructions
* remove legacy db

* change message for when legacy db is detected

* nit

* nits

* remove unneeded

* circular import avoid revert

* nits

* remove legacy db example

* remove 2 more outdated databases

* clean up removed db version references

* remove one more old ref

* remove last legacy db

---------

Co-authored-by: Aaron <[email protected]>
* shuffling

* update standard.md to mention python versions tested

* de-circularizing

* finishing up decircularization

* fix imports in tests

* more import fixes

* more import fixes

* updating docs and docstrings with new locations

* add temp to bedrock and ignored warning

* trying to remove circular import

* more debugging

* more fixes

* more of the same

* last few

* missed on

* nits

* typo

* fix feedbackmode imports

* 2 more fixes
* Fixes to package build.

* bump version
…las notebook update (#1097)

* fix dividing by zero error

* update notebook for webinar
* pin openai version for hackathon

* runnable e2e

* add migration guide
* oss models in app

* import change

* fix dims issue, pass embeddings manually

* keep some output

* remove settings print

* link model list for cost tracking
removed this so it's less confusing for newcomers
* azureopenai docstring

* azureopenai.md

* remove extra references to supported feedbacks

* Update azureopenai.md
* fix link on langchain instrumentation docs

* fix llama-index quickstart link

* fix langchain instrumentation docs, add missing imports

* add missing imports to nemo instrumentation docs
* fix rag triad and awaitable calls

* remove locals printout in awaitables message
* fix rag triad and awaitable calls

* remove locals printout in awaitables message

* update __getattr__ in select_context (#1119)

---------

Co-authored-by: Piotr Mardziel <[email protected]>
* Update feedback.py

* use name
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.