ModuleNotFoundError: No module named 'ragas.testset.generator'

[ParthP8399]

[ ] I have checked the documentation and related resources and couldn't resolve my bug.

Describe the bug
I want to generate synthetic data through RAG and evaluate the RAG using the synthentic data generated

Ragas version: 0.2.10
Python version: 3.13.1

Code to Reproduce
import ragas
from ragas.testset.generator import TestsetGenerator
from ragas.testset.evolutions import simple, reasoning, multi_context

generator with openai models

generator = TestsetGenerator.with_openai(critic_llm = "gpt-4")

Change resulting question type distribution

distributions = {
simple: 0.3,
multi_context: 0.2,
reasoning: 0.5
}

testset = generator.generate_with_langchain_docs(pages, 10, distributions)
testset.to_pandas()

Error trace
I am getting this error whenever i try to import the module. ModuleNotFoundError: No module named 'ragas.testset.generator'

[ParthP8399]

@dosu
why don't you give me the answer?

[dosubot]

I found a similar closed issue regarding the error "ModuleNotFoundError: No module named 'ragas.testset'; 'ragas' is not a package" ^[1]. However, no solution was found in the comments of that issue.

For Ragas version 0.2.10, the correct import paths for generating synthetic data are:

from ragas.testset.generator import TestsetGenerator
from ragas.testset.evolutions import simple, reasoning, multi_context

If you are still encountering the error, it might be worth checking if the module has been moved or renamed in recent versions, or if there are any issues with your installation of the Ragas package. Additionally, ensure that your Python environment is correctly set up and that the Ragas package is properly installed.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[Vidit-Ostwal]

I think there is some error with the documentation, ideally this should be more like

from ragas.testset import TestsetGenerator
from ragas.testset import Testset, TestsetSample

Try this, this should work with your

ragas version == 0.2.10

Maybe another issue can be raised for the documentation error

[Vidit-Ostwal]

@dosu What do you think?

[jjmachan]

thanks a lot for helping out @Vidit-Ostwal 🙌🏽
@ParthP8399 hope it is resolved now?

[dosubot]

Yes, for Ragas version 0.2.10, the correct import paths are indeed:

from ragas.testset import TestsetGenerator
from ragas.testset import Testset, TestsetSample

This is confirmed by the __init__.py file in the ragas.testset module, which makes these classes available for import from ragas.testset ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}