Multi-document setting

[rhythmcao]

Thanks a lot for providing this meaningful benchmark.

I notice that in the Table 2 of the raw paper, 10.9% questions include multiple documents. But when I download the test.jsonl file from the HF, the clear data format does not have the multiple document field? It only includes the pid, which I assume should be the paper id according to OpenReview.

[rhythmcao]

By the way, if the external documents are implicitly mentioned in the question and should be referenced to answer the question, is it possible for me to obtain the concrete sources or URLs? Or how can I distinguish different categories of the questions (defined in Table 2) such that I can get a more fine-grained evaluation on different splits?