List your company

Visual Question Answering on MathVista mini (test)

78.4AccuracyProprietary API SOTA (SenseTime, 2024)
62.866.8570.974.95Jan 21, 2025

Evaluation results

MethodLinks
Proprietary API SOTA (SenseTime, 2024)Model Type=Proprietary API, Evaluation Protocol=VQA2025.0178.4
Open-Source SOTA (Lu et al., 2024a)Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0166.5
IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0163.7
IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0163.4