Diagram Understanding on AI2D (Accuracy and Avg. %)
84.5AccuracyQwen2.5-VL-32B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-VL-32BToken Budget=100%, Backbone Model=Qwen2.5-VL-32B2026.04 | 84.5 | 100 | |
| InternVL-2.5Size=8B2026.06 | 84.5 | 68 | |
| InternVL2.5-MPOSize=8B2026.06 | 84.2 | 69.4 | |
| MMS-PRMSize=8B2026.06 | 84.2 | 73 | |
| Qwen2-VLSize=7B2026.06 | 83 | 65.1 | |
| DivPruneToken Budget=35.3%, Backbone Model=Qwen2.5-VL-32B2026.04 | 82.2 | 93.4 | |
| IWPToken Budget=35.3%, Backbone Model=Qwen2.5-VL-32B2026.04 | 82.2 | 94.2 | |
| MiniCPM-V-2-6Size=8B2026.06 | 82.1 | 64.2 | |
| VisionZipToken Budget=35.3%, Backbone Model=Qwen2.5-VL-32B2026.04 | 81.9 | 94 | |
| InternVL2.5-MPO + SFTSize=8B2026.06 | 81.6 | 71 | |
| IXC-2.5Size=7B2026.06 | 81.5 | — | |
| LLaVA-OneVisionSize=7B2026.06 | 81.4 | 64.6 | |
| LlamaV-o1Size=11B2026.06 | 81.2 | — | |
| Insight-VSize=7B2026.06 | 79.8 | 65.7 | |
| IWPToken Budget=22.2%, Backbone Model=Qwen2.5-VL-32B2026.04 | 79.4 | 89.6 | |
| VisionZipToken Budget=22.2%, Backbone Model=Qwen2.5-VL-32B2026.04 | 78.9 | 86.2 | |
| CDPrunerToken Budget=35.3%, Backbone Model=Qwen2.5-VL-32B2026.04 | 78.8 | 87.2 | |
| LLaVA-CoTSize=11B2026.06 | 78.7 | — | |
| FastVToken Budget=35.3%, Backbone Model=Qwen2.5-VL-32B2026.04 | 78.6 | 90.8 | |
| DivPruneToken Budget=22.2%, Backbone Model=Qwen2.5-VL-32B2026.04 | 77.9 | 87.7 | |
| LLaVA-NeXT-LLaMA3 + SFTSize=8B2026.06 | 76.1 | 60.8 | |
| FastVToken Budget=22.2%, Backbone Model=Qwen2.5-VL-32B2026.04 | 75.3 | 84 | |
| IWPToken Budget=11.1%, Backbone Model=Qwen2.5-VL-32B2026.04 | 74 | 81.5 | |
| VisionZipToken Budget=11.1%, Backbone Model=Qwen2.5-VL-32B2026.04 | 73 | 75.1 | |
| CDPrunerToken Budget=22.2%, Backbone Model=Qwen2.5-VL-32B2026.04 | 72.9 | 81.3 | |
| DivPruneToken Budget=11.1%, Backbone Model=Qwen2.5-VL-32B2026.04 | 72.4 | 78.9 | |
| LLaVA-NeXT-LLaMA3Size=8B2026.06 | 71.5 | 52.1 | |
| FastVToken Budget=11.1%, Backbone Model=Qwen2.5-VL-32B2026.04 | 70.4 | 73.2 | |
| CDPrunerToken Budget=11.1%, Backbone Model=Qwen2.5-VL-32B2026.04 | 67.9 | 71.8 |