Chart Understanding and Reasoning on CharXiv
67.8ScoreGemini 2.5 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.5 ProTool=Code, Param Size=-2025.11 | 67.8 | |
| Claude-3.7-SonnetData=-2025.12 | 64.2 | |
| Vero Mi-7BRL=MiMoVL, Initial Model=7B-SFT2026.04 | 63.5 | |
| MiMo-VL-7B-SFTRun=+TRON2026.06 | 62.6 | |
| MiMoVL 7B-RLRL=MiMoVL, Initial Model=7B-SFT2026.04 | 60.9 | |
| Vero Q3T-8BRL=Qwen3VL, Initial Model=8B Think2026.04 | 59.9 | |
| MiMo-VL-7B-SFTRun=Base2026.06 | 58.7 | |
| Vero Q3I-8BRL=Qwen3VL, Initial Model=8B Inst2026.04 | 53.7 | |
| Q3VL 8B-ThkRL=N/A, Initial Model=N/A2026.04 | 53 | |
| GPT-5 NanoRL=N/A, Initial Model=N/A2026.04 | 51.2 | |
| BiPS-General-7BData=13K+39K2025.12 | 50.6 | |
| BiPS-Chart-7BData=13K2025.12 | 49.4 | |
| DeepEyesV2Tool=General, Param Size=7B2025.11 | 48.9 | |
| Qwen2.5-VLTool=✗, Param Size=32B2025.11 | 48 | |
| GPT-4oTool=Code, Param Size=-2025.11 | 47.5 | |
| GPT-4oData=-2025.12 | 47.1 | |
| Vero Q25-7BRL=Qwen25VL, Initial Model=7B Inst2026.04 | 47.1 | |
| Q3VL 8B-InsRL=N/A, Initial Model=N/A2026.04 | 46.4 | |
| Chart-R1-7BData=258K2025.12 | 46.2 | |
| GRPOData=13K + 39K2025.12 | 45.4 | |
| DeepEyes-7BData=14K + 33K2025.12 | 42.9 | |
| Qwen2.5-VL-7BData=-2025.12 | 42.5 | |
| Vision-R1-7BData=73K + 137K2025.12 | 42.5 | |
| Q25VL 7B-InsRL=N/A, Initial Model=N/A2026.04 | 42.5 | |
| Qwen3-VL-4B-InstructRun=+TRON2026.06 | 42.4 | |
| BigCharts-R1-7BData=1.7M2025.12 | 41.3 | |
| Qwen2.5-VLTool=✗, Param Size=7B2025.11 | 40.2 | |
| Qwen3-VL-4B-InstructRun=Base2026.06 | 39.8 | |
| Qwen2.5-VL-7B-InstructRun=+TRON2026.06 | 38.9 | |
| InternVL3-8BData=-2025.12 | 37.6 | |
| InternVL3Tool=✗, Param Size=8B2025.11 | 37.6 | |
| Qwen2.5-VL-7B-InstructRun=Base2026.06 | 37.4 | |
| Mo2-O 7BRL=SFT Only, Initial Model=N/A2026.04 | 35.6 | |
| R1-OneVision-7BData=67K + 98K2025.12 | 33.8 | |
| ChartLlama-13BData=160K2025.12 | 14.2 | |
| ChartGemma-3BData=163K2025.12 | 12.5 | |
| TinyChart-3BData=1.3M2025.12 | 8.3 |