Vision Understanding on MMMU Pro
50.6AccuracyReGap
Evaluation Results
| Method | Links | |
|---|---|---|
| ReGapBase Model=Qwen3-Omni-30B-A3B-Instruct2026.05 | 50.6 | |
| BaseBase Model=Qwen3-Omni-30B-A3B-Instruct2026.05 | 50 | |
| ReGapBase Model=MiniCPM-o-4.52026.05 | 45.4 | |
| BaseBase Model=MiniCPM-o-4.52026.05 | 43.4 | |
| ShiftDCBase Model=MiniCPM-o-4.52026.05 | 42.5 | |
| ShiftDCBase Model=Qwen3-Omni-30B-A3B-Instruct2026.05 | 40.4 | |
| ReGapBase Model=Qwen2.5-Omni-3B2026.05 | 25.4 | |
| ShiftDCBase Model=Qwen2.5-Omni-3B2026.05 | 25.2 | |
| SPA-VL-DPOBase Model=Qwen2.5-Omni-3B2026.05 | 25.2 | |
| BaseBase Model=Qwen2.5-Omni-3B2026.05 | 25 | |
| VLGuard-SFTBase Model=Qwen2.5-Omni-3B2026.05 | 23.2 |