Diagram Understanding on AI2D (EM)
79.11Exact MatchBaseline
Evaluation Results
| Method | Links | |
|---|---|---|
| BaselineBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=100%, Compression Ratio=0%2026.02 | 79.11 | |
| IDPrunerBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Hybrid strategies2026.02 | 75.94 | |
| SCOPEBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Hybrid strategies2026.02 | 75.84 | |
| VisionSelectorBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Importance-based2026.02 | 75.19 | |
| VisPrunerBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Hybrid strategies2026.02 | 74.29 | |
| VisionZipBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Importance-based2026.02 | 74.19 | |
| HiPruneBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Importance-based2026.02 | 73.83 | |
| DivPruneBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Diversity-based2026.02 | 73.06 | |
| FastVBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Importance-based2026.02 | 72.7 | |
| IDPrunerBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Hybrid strategies2026.02 | 71.79 | |
| DARTBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=25%, Compression Ratio=75%, Method Category=Diversity-based2026.02 | 71.08 | |
| VisionSelectorBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Importance-based2026.02 | 70.5 | |
| SCOPEBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Hybrid strategies2026.02 | 69.75 | |
| HiPruneBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Importance-based2026.02 | 67.75 | |
| VisPrunerBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Hybrid strategies2026.02 | 67.75 | |
| DivPruneBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Diversity-based2026.02 | 67.71 | |
| VisionZipBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Importance-based2026.02 | 67.65 | |
| DARTBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Diversity-based2026.02 | 67.49 | |
| FastVBase Model=Qwen2.5-VL-3B-Instruct, Token Retention Rate=10%, Compression Ratio=90%, Method Category=Importance-based2026.02 | 65.87 |