Description

MathVista is a benchmark for assessing mathematical reasoning in visual contexts for LLMs and LMMs. It contains 6,141 examples drawn from 28 existing multimodal datasets and 3 newly created datasets (IQTest, FunctionQA, PaperQA), designed to require fine-grained visual understanding and compositional reasoning.