Chart Understanding on ReachQA
51.7Reasoning ScoreClaude Sonnet 3.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude Sonnet 3.5Param.=–2026.04 | 51.7 | — | — | 74.3 | |
| Qwen3-VL-8BParam.=8B2026.04 | 47.7 | — | — | 70.7 | |
| CHARTOOL-7BParam.=7B2026.04 | 46.3 | — | — | 72.3 | |
| Qwen2.5-VL-72BParam.=72B2026.04 | 43.9 | — | — | 71.9 | |
| Deepeyes-V2Param.=7B2026.04 | 43.1 | — | — | 68 | |
| GPT-4oParam.=–2026.04 | 39.7 | — | — | 66.8 | |
| ThymeParam.=7B2026.04 | 38.8 | — | — | 66.9 | |
| DeepeyesParam.=7B2026.04 | 38.5 | — | — | 68.3 | |
| Qwen2.5-VL-7BParam.=7B2026.04 | 37.7 | — | — | 70.5 | |
| CHARTOOL-3BParam.=3B2026.04 | 36.7 | — | — | 61.4 | |
| ECD Qwen2.5-VL-7BParam.=7B2026.04 | 36.2 | — | — | 69.5 | |
| InternVL3-8BParam.=8B2026.04 | 30.5 | — | — | 59.4 | |
| Qwen2.5-VL-3BParam.=3B2026.04 | 26.8 | — | — | 59.2 | |
| ChartMOEParam.=8B2026.04 | 11.5 | — | — | 37.3 | |
| ChartGemmaParam.=3B2026.04 | 7.3 | — | — | 26.9 | |
| TinyChartParam.=3B2026.04 | 6.2 | — | — | 21.1 | |
| Bespoke-MiniChartChart Number=13.0k, QA Number=91k2025.09 | — | 54 | 50.1 | — | |
| ECD-Qwen2.5VL-7bChart Number=10.5k, QA Number=320k2025.09 | — | 53.5 | 46.9 | — | |
| Gemini2.0-Flashmodel_category=Proprietary Model2025.09 | — | 63 | — | — | |
| GPT-4omodel_category=Proprietary Model2025.09 | — | 53.3 | — | — | |
| MM-Eureka-Qwen-7Bbase_model=Qwen2.5-VL-7B2025.09 | — | 51.3 | — | — | |
| OpenVLThinker-7Bbase_model=Qwen2.5-VL-7B2025.09 | — | 51.5 | — | — | |
| Qwen2.5-VL-7Bbase_model=Qwen2.5-VL-7B2025.09 | — | 50.8 | — | — | |
| Qwen2.5VL-7bChart Number=-, QA Number=-2025.09 | — | 50.8 | 46.7 | — | |
| R1-OneVision-7Bbase_model=Qwen2.5-VL-7B2025.09 | — | 46.5 | — | — | |
| ViGaL-Snake+Rotationbase_model=Qwen2.5-VL-7B2025.09 | — | 51.8 | — | — | |
| VisionZero-Qwen-7B (Chart)training_context=Chart, base_model=Qwen2.5-VL-7B2025.09 | — | 53.4 | — | — | |
| VisionZero-Qwen-7B (CLEVR)training_context=CLEVR, base_model=Qwen2.5-VL-7B2025.09 | — | 52.2 | — | — | |
| VisionZero-Qwen-7B (Real-World)training_context=Real-World, base_model=Qwen2.5-VL-7B2025.09 | — | 52.8 | — | — | |
| VisionZero-Qwen-7B(chart)Chart Number=2.0k, QA Number=02025.09 | — | 53.8 | 50.2 | — | |
| VLAA-Thinker-7Bbase_model=Qwen2.5-VL-7B2025.09 | — | 50.4 | — | — |