Corrupted MathVista testmini data

[LeoDu0314]

I found that the MathVista testmini data used in VLMEvalkit(https://opencompass.openxlab.space/utils/VLMEval/MathVista_MINI.tsv) is not identical to that provided by the MathVista offical huggingface repo(https://huggingface.co/datasets/AI4Math/MathVista)

The VLMEvalkit version of MathVista testmini data has the following problem:

• Images are compressed
• Misuse of \r\n in some questions.

Could you provide an updated version of MathVista testmini?

[kennymckormick]

Hi, @LeoDu0314 ,
During our pre-processing, we have converted images to JPEG format. We will try to build another version that do not perform the JPEG conversion and do the evaluation again to see the gap.