Chart Understanding on ChartQA 1.0 (test)
90.8Avg Relaxed AccuracyClaude-3.5-Sonnet
Evaluation results
| Method | Links | |
|---|---|---|
| Claude-3.5-Sonnet2024.12 | 90.8 | |
| InternVL2-Llama3-76B2024.12 | 88.4 | |
| Qwen2-VL-72B2024.12 | 88.3 | |
| InternVL2.5-78B2024.12 | 88.3 | |
| InternVL2.5-38B2024.12 | 88.2 | |
| Molmo-72B2024.12 | 87.3 | |
| InternVL2.5-26B2024.12 | 87.2 | |
| Gemini-1.5-Pro2024.12 | 87.2 | |
| InternVL2-40B2024.12 | 86.2 | |
| NVLM-D-72B2024.12 | 86 | |
| GPT-4o-202405132024.12 | 85.7 | |
| InternVL2-26B2024.12 | 84.9 | |
| InternVL2.5-8B2024.12 | 84.8 | |
| Molmo-7B-D2024.12 | 84.1 | |
| InternVL2.5-4B2024.12 | 84 | |
| InternVL-Chat-V1.52024.12 | 83.8 | |
| LLaVA-OneVision-72B2024.12 | 83.7 | |
| InternVL2-8B2024.12 | 83.3 | |
| Qwen2-VL-7B2024.12 | 83 | |
| MiniCPM-V2.62024.12 | 82.4 | |
| Phi-3.5-Vision-4B2024.12 | 81.8 | |
| InternVL2-4B2024.12 | 81.5 | |
| Claude-3-Opus2024.12 | 80.8 | |
| InternVL2.5-2B2024.12 | 79.2 | |
| GPT-4V2024.12 | 78.5 | |
| Aquila-VL-2B2024.12 | 76.5 | |
| InternVL2-2B2024.12 | 76.2 | |
| InternVL2.5-1B2024.12 | 75.9 | |
| Cambrian-34B2024.12 | 75.6 | |
| Qwen2-VL-2B2024.12 | 73.5 | |
| InternVL2-1B2024.12 | 72.9 | |
| VILA-1.5-40B2024.12 | 67.2 | |
| LLaVA-OneVision-0.5B2024.12 | 61.4 |