Visual Question Answering on MathVision full (test)
43.6AccuracyProprietary API SOTA (Google, 2024)
Evaluation Results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (Google, 2024)Model Type=Proprietary API, Evaluation Protocol=VQA2025.01 | 43.6 | |
| Open-Source SOTA (Liu et al., 2024c)Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 22 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 18.8 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 17.8 |