List your company
ResearchFormerly WizWand

Vision Understanding on MMMU Pro

50.6AccuracyReGap
22.10429.50236.944.298May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ReGapBase Model=Qwen3-Omni-30B-A3B-Instruct2026.0550.6
BaseBase Model=Qwen3-Omni-30B-A3B-Instruct2026.0550
ReGapBase Model=MiniCPM-o-4.52026.0545.4
BaseBase Model=MiniCPM-o-4.52026.0543.4
ShiftDCBase Model=MiniCPM-o-4.52026.0542.5
ShiftDCBase Model=Qwen3-Omni-30B-A3B-Instruct2026.0540.4
ReGapBase Model=Qwen2.5-Omni-3B2026.0525.4
ShiftDCBase Model=Qwen2.5-Omni-3B2026.0525.2
SPA-VL-DPOBase Model=Qwen2.5-Omni-3B2026.0525.2
BaseBase Model=Qwen2.5-Omni-3B2026.0525
VLGuard-SFTBase Model=Qwen2.5-Omni-3B2026.0523.2