Chart Data Extraction on ExChart-Bench 1.0 (test)
99.83Format Success Rate (All)GPT-4o
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4oModel Category=Commercial proprietary models2026.06 | 99.83 | 99.5 | 100 | 99.86 | 100 | 99.86 | 13.38 | 13.87 | 9.53 | 7.61 | 11.35 | 39.65 | |
| Gemini 2.5 FlashModel Category=Commercial proprietary models2026.06 | 99.72 | 99.75 | 99.86 | 100 | 99 | 100 | 6.72 | 3.78 | 4.35 | 2.63 | 11.58 | 28.01 | |
| GLM-4.5V (>100B)Model Category=Open-source models, Size=>100B2026.06 | 99.39 | 99.38 | 98.14 | 99.43 | 100 | 100 | 5.94 | 3.83 | 5.56 | 4.79 | 9.24 | 13.03 | |
| Qwen2.5-VL 72BModel Category=Open-source models, Size=72B2026.06 | 99.28 | 98.12 | 98.71 | 100 | 99.86 | 99.86 | 9.1 | 8.81 | 6.57 | 4.63 | 10.45 | 27.44 | |
| ExChart (7B)Model Category=Open-source models, Size=7B2026.06 | 99.11 | 99 | 98.29 | 99.86 | 98.57 | 99.86 | 4.87 | 5.66 | 7.93 | 0.85 | 5.73 | 3.21 | |
| ExChart w/o CSPE (7B)Model Category=Open-source models, Size=7B, Ablation=w/o CSPE2026.06 | 98.94 | 97.12 | 98.14 | 100 | 100 | 99.71 | 5.94 | 10.82 | 6.69 | 0.62 | 4.5 | 4.59 | |
| GPT-4.1Model Category=Commercial proprietary models2026.06 | 98.89 | 97.75 | 99.14 | 98.14 | 99.71 | 99.86 | 7.49 | 10.53 | 6.43 | 5.77 | 4.59 | 8.83 | |
| InternVL3.5 4BModel Category=Open-source models, Size=4B2026.06 | 98.69 | 98.88 | 97.71 | 100 | 98.14 | 98.71 | 11.75 | 6.09 | 9.02 | 7.17 | 19.38 | 40.56 | |
| Qwen2.5-VL 32BModel Category=Open-source models, Size=32B2026.06 | 97.83 | 94.88 | 95.57 | 99.86 | 99.29 | 100 | 10.7 | 10.17 | 8.08 | 5.11 | 11.76 | 33.03 | |
| ExChart w/o CTA (7B)Model Category=Open-source models, Size=7B, Ablation=w/o CTA2026.06 | 95.78 | 90.12 | 96.43 | 99.86 | 96.43 | 96.86 | 11.17 | 21.9 | 11.98 | 0.58 | 9 | 6.95 | |
| InternVL3.5 38BModel Category=Open-source models, Size=38B2026.06 | 94.14 | 98.12 | 90.57 | 100 | 98 | 83.43 | 10.26 | 6.57 | 9.35 | 4.01 | 13.75 | 36.25 | |
| Qwen2.5-VL 7BModel Category=Open-source models, Size=7B2026.06 | 89.58 | 90.88 | 69.71 | 97.86 | 95.57 | 93.71 | 16.01 | 13.72 | 22.4 | 8.18 | 14.64 | 25.47 | |
| InternVL3.5 14BModel Category=Open-source models, Size=14B2026.06 | 74.56 | 76.62 | 62 | 99.86 | 58.29 | 75.71 | 23.13 | 19.39 | 25.78 | 7.3 | 42.41 | 48.82 | |
| LLaVA 1.6 Mistral 7BModel Category=Open-source models, Size=7B2026.06 | 66.92 | 64.75 | 50.43 | 82.43 | 79.29 | 58 | 70.52 | 68.96 | 72.64 | 73.53 | 61.73 | 69.4 |