-
-
Notifications
You must be signed in to change notification settings - Fork 293
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Introduce not given and apply it to dataset's target #1612
Introduce not given and apply it to dataset's target #1612
Conversation
# Conflicts: # giskard/datasets/base/__init__.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me @kevinmessiaen.
Could we also undo the changes done in https://github.com/Giskard-AI/giskard/pull/1531/files (the ones related to suppress the warning of target for LLM) and add the target=None
in the BaseModel for when model_type == "text_generation"
to suppress the warning?
Not sure to understand the logic of the validation though, why to we validate the dataset target when validating model? For me this validation is completely unrelated to the model validation and should be done when validating dataset only. |
that's exactly what I meant by my comment. We should remove it. |
Thanks for clarification, so it's what I did then, you can review the PR when you have time |
# Conflicts: # docs/reference/notebooks/LLM_QA_Google.ipynb # giskard/core/model_validation.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @kevinmessiaen, looks good
Kudos, SonarCloud Quality Gate passed! |
Description
Introduce not given and apply it to dataset's target
Related Issue
Type of Change
Checklist
CODE_OF_CONDUCT.md
document.CONTRIBUTING.md
guide.make codestyle
.