Multi-modal Understanding on MM-Bench (MMB) (test)
86.3MMB ScoreQwen
Evaluation Results
| Method | Links | |
|---|---|---|
| QwenToken Retention Rate=100%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 86.3 | |
| HiPruneToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 82.6 | |
| HiPrune++Token Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 82.6 | |
| VisionZipToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 82.2 | |
| HiPruneToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 77.2 | |
| HiPrune++Token Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 76.6 | |
| FastVToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 76.4 | |
| VisionZipToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 76 | |
| HiPruneToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 71.3 | |
| HiPrune++Token Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 70.3 | |
| VisionZipToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 69.8 | |
| FastVToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 67.2 | |
| FastVToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.08 | 56.4 |