List your company
ResearchFormerly WizWand

Multi-modal Understanding on MM-Bench (MMB) (test)

86.3MMB ScoreQwen
55.20463.27771.3579.423Aug 1, 2025
Updated 6mo ago

Evaluation results

MethodLinks
QwenToken Retention Rate=100%, Base Model=Qwen2.5-VL-32B-Instruct2025.0886.3
HiPruneToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0882.6
HiPrune++Token Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0882.6
VisionZipToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0882.2
HiPruneToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0877.2
HiPrune++Token Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0876.6
FastVToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0876.4
VisionZipToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0876
HiPruneToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0871.3
HiPrune++Token Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0870.3
VisionZipToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0869.8
FastVToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0867.2
FastVToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0856.4