Document and chart understanding on ChartQA (Pass@1)
89.5Pass@1Qwen 2.5-VL 72B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen 2.5-VL 72Bthinking=false, decoding=greedy2025.05 | 89.5 | |
| Seed 1.5-VLthinking=true, decoding=greedy2025.05 | 89.1 | |
| Seed 1.5-VLthinking=false, decoding=greedy2025.05 | 87.4 | |
| GPT-4othinking=false, decoding=greedy2025.05 | 86.7 | |
| Gemini 1.5 Prothinking=true, decoding=greedy2025.05 | 83.3 | |
| OpenAI o1thinking=true, decoding=greedy2025.05 | 83.1 | |
| Claude 3.7 Sonnetthinking=true, decoding=sampling2025.05 | 56.5 |