List your company
ResearchFormerly WizWand

Multimodal Evaluation on Aggregate Benchmarks

100Average ScoreBaseline
68.38476.59284.893.008Aug 1, 2025Sep 1, 2025Oct 3, 2025Nov 4, 2025Dec 5, 2025Jan 6, 2026Feb 7, 2026
Updated 6mo ago

Evaluation results

MethodLinks
BaselineBase Model=Qwen-2.5-VL-7B-Instruct2026.02100
QwenToken Retention Rate=100%, Base Model=Qwen2.5-VL-32B-Instruct2025.08100
HiPruneToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0896.2
HiPrune++Token Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0895.7
VisionZipToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0895.6
IDPrunerRetained Tokens=25%2026.0295.18
HiPruneToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0890.1
VisionZipToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0889.8
HiPrune++Token Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0889.8
FastVToken Retention Rate=22.2%, Base Model=Qwen2.5-VL-32B-Instruct2025.0888.6
IDPrunerRetained Tokens=10%2026.0286.47
HiPruneToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0884.7
HiPrune++Token Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0884
VisionZipToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0883.5
FastVToken Retention Rate=11.1%, Base Model=Qwen2.5-VL-32B-Instruct2025.0877.7
FastVToken Retention Rate=5.6%, Base Model=Qwen2.5-VL-32B-Instruct2025.0869.6