List your company

Visual Question Answering on MathVerse vision-only (test)

54.8AccuracyProprietary API SOTA (Google, 2024)
14.65625.07835.545.922Jan 21, 2025

Evaluation results

MethodLinks
Proprietary API SOTA (Google, 2024)Model Type=Proprietary API, Evaluation Protocol=VQA2025.0154.8
Open-Source SOTA (Liu et al., 2024c)Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0126.6
IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0119
IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.0116.2