Chart Reconstruction on ChartMimic
93.5Execution RateChartSpec
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ChartSpecPara.=7B, SFT_Data=4k2026.02 | 93.5 | 80.5 | 92.8 | 82 | 67 | 80.6 | 84.2 | 82.4 | |
| GPT-4oPara.=–2026.02 | 93.2 | 81.5 | 89.8 | 77.3 | 67.2 | 79 | 83.5 | 81.2 | |
| ChartCoderPara.=7B2026.02 | 91.4 | 67.2 | 95 | 78.5 | 69 | 77.4 | 74 | 75.7 | |
| ChartSpecPara.=7B, SFT_Data=3k2026.02 | 90.2 | 73.7 | 90.7 | 83.7 | 65.7 | 78.4 | 81.4 | 79.9 | |
| Claude-3-opusPara.=–2026.02 | 83.3 | 66.8 | 83.1 | 49.9 | 42.1 | 60.5 | 60.1 | 60.3 | |
| InternVL2-Llama3-76BPara.=76.0B2026.02 | 83.2 | 54.1 | 74.5 | 49.2 | 41.5 | 54.8 | 62.2 | 58.5 | |
| ChartVLM-LPara.=14.3B2026.02 | 83.2 | — | — | — | — | 15.8 | 13.9 | 14.9 | |
| MiniCPM-Llama3-V-2.5Para.=8.4B2026.02 | 80.3 | 30.7 | 49.6 | 38.6 | 27.6 | 36.6 | 42.1 | 39.4 | |
| InternVL2-26BPara.=26.0B2026.02 | 69.3 | 39.2 | 58.7 | 35.9 | 31.8 | 41.4 | 47.4 | 44.4 | |
| Qwen2.5-VL-7B(backbone)Para.=7B2026.02 | 69.2 | 52 | 77.2 | 74.3 | 47.1 | 62.7 | 63.2 | 63 | |
| GeminiProVisionPara.=–2026.02 | 68.2 | 52.6 | 64.2 | 51.3 | 47.1 | 53.8 | 53.3 | 53.6 | |
| Qwen2-VL-7BPara.=8.2B2026.02 | 67 | 26.4 | 51 | 31 | 23.3 | 32.9 | 35 | 34 | |
| InternVL2-4BPara.=4.2B2026.02 | 66.2 | 34.7 | 51.7 | 25.2 | 23.6 | 33.8 | 38.4 | 36.1 | |
| InternVL2-8BPara.=8.1B2026.02 | 61.8 | 31.5 | 51.1 | 28.6 | 26.2 | 34.4 | 38.9 | 36.6 | |
| LLaVA-Next-Mistral-7BPara.=7.6B2026.02 | 59.7 | 14 | 31.1 | 19.8 | 17.8 | 20.7 | 21.3 | 21 | |
| ChartLlamaPara.=13B2026.02 | 57.5 | — | — | — | — | 24.8 | 28.1 | 26.5 | |
| InternVL2-2BPara.=2.2B2026.02 | 52.5 | 23.6 | 35.8 | 16 | 15.4 | 22.7 | 24.2 | 23.5 | |
| LLaVA-Next-Yi-34BPara.=34.8B2026.02 | 50.2 | 15.9 | 29.6 | 17.6 | 15.2 | 19.6 | 20.6 | 20.1 | |
| Qwen2-VL-2BPara.=2.6B2026.02 | 47 | 20.1 | 29.5 | 21.3 | 17.9 | 22.2 | 23.4 | 22.8 | |
| TinyChartPara.=3B2026.02 | 42.5 | — | — | — | — | 26.3 | 25.9 | 26.1 | |
| DeepSeek-VL-7BPara.=7.3B2026.02 | 41.3 | 15.3 | 26.6 | 19.7 | 14.5 | 19 | 20.4 | 19.7 |