Visual Question Answering on MathVista mini (test)
78.4AccuracyProprietary API SOTA (SenseTime, 2024)
Evaluation Results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (SenseTime, 2024)Model Type=Proprietary API, Evaluation Protocol=VQA2025.01 | 78.4 | |
| Open-Source SOTA (Lu et al., 2024a)Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 66.5 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 63.7 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 63.4 |