List your company
ResearchFormerly WizWand

Visual Question Answering on MME (Total Score)

2,448MME Total ScoreQwen2.5-VL
1,074.161,430.831,787.52,144.17May 29, 2025Jul 30, 2025Oct 1, 2025Dec 3, 2025Feb 4, 2026Apr 8, 2026Jun 10, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen2.5-VLModel Size=72B2026.042,448
VanillaSource=Qwen’25, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=0%2026.062,378
VanillaBackbone=QWEN-2.5-VL 7B, Average Tokens=100%2026.022,347
Qwen2.5-VLModel Size=7B2026.042,347
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=75%2026.022,340
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=50%2026.022,330
ForeSightModel Size=7B2026.042,326
VanillaSource=Qwen’25, Token Reduction=0%, Backbone=Qwen2.5-VL-7B2026.062,318
NuwaBackbone=QWEN-2.5-VL 7B, Average Tokens=25%2026.022,313
Qwen2.5-VLModel Size=7B, Reproduced=true2026.042,288.2
PDrop+RerouteSource=Ours, Token Reduction=66.7%, Backbone=Qwen2.5-VL-7B2026.062,243
PDropSource=CVPR’25, Token Reduction=66.7%, Backbone=Qwen2.5-VL-7B2026.062,213
FastV+RerouteSource=Ours, Token Reduction=66.7%, Backbone=Qwen2.5-VL-7B2026.062,184
FastVSource=ECCV’24, Token Reduction=66.7%, Backbone=Qwen2.5-VL-7B2026.062,178
PDrop+RerouteSource=Ours, Token Reduction=77.8%, Backbone=Qwen2.5-VL-7B2026.062,078
PDropSource=CVPR’25, Token Reduction=77.8%, Backbone=Qwen2.5-VL-7B2026.062,056
PDrop+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=66.7%2026.062,042
FastV+RerouteSource=Ours, Token Reduction=77.8%, Backbone=Qwen2.5-VL-7B2026.062,002
FastVSource=ECCV’24, Token Reduction=77.8%, Backbone=Qwen2.5-VL-7B2026.061,994
PDrop+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=77.8%2026.061,932
FastV+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=66.7%2026.061,929
PDropSource=CVPR’25, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=66.7%2026.061,924
PDrop+RerouteSource=Ours, Token Reduction=88.9%, Backbone=Qwen2.5-VL-7B2026.061,874
FastVSource=ECCV’24, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=66.7%2026.061,823
FastV+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=77.8%2026.061,798
PDropSource=CVPR’25, Token Reduction=88.9%, Backbone=Qwen2.5-VL-7B2026.061,755
PDrop+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=88.9%2026.061,711
PDropSource=CVPR’25, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=77.8%2026.061,688
FastVSource=ECCV’24, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=77.8%2026.061,547
FastV+RerouteSource=Ours, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=88.9%2026.061,539
PDropSource=CVPR’25, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=88.9%2026.061,431
LLaVA-1.5-13BModel=LLaVA-1.5-13B, Cropped Images=false2025.051,390
LLaVA-1.5-13B + QLIPModel=LLaVA-1.5-13B, Cropped Images=true2025.051,388
FastVSource=ECCV’24, Backbone=Qwen3.5-9B-Hybrid, Average Gated Attention Token Reduction=88.9%2026.061,263
FastV+RerouteSource=Ours, Token Reduction=88.9%, Backbone=Qwen2.5-VL-7B2026.061,247
LLaVA-1.5-7b + QLIPModel=LLaVA-1.5-7b, Cropped Images=false2025.051,241
LLaVA-1.5-7bModel=LLaVA-1.5-7b, Cropped Images=false2025.051,207
FastVSource=ECCV’24, Token Reduction=88.9%, Backbone=Qwen2.5-VL-7B2026.061,127