Multimodal Understanding on MMAU (ACC)
77.6ACCBase
Evaluation Results
| Method | Links | |
|---|---|---|
| BaseModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 77.6 | |
| ReGapModel=MiniCPM-o-4.52026.05 | 76.8 | |
| ReGapModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 76.8 | |
| BaseModel=MiniCPM-o-4.52026.05 | 76.2 | |
| Qwen3 Omni 30BParameters=30B2026.06 | 75.4 | |
| CogniRoute2026.06 | 73.2 | |
| ReGapModel=Qwen2.5-Omni-3B2026.05 | 66.8 | |
| BaseModel=Qwen2.5-Omni-3B2026.05 | 66 | |
| Refusal SteeringModel=Qwen3-Omni-30B-A3B-Instruct2026.05 | 35.6 | |
| Refusal SteeringModel=MiniCPM-o-4.52026.05 | 30.4 | |
| Refusal SteeringModel=Qwen2.5-Omni-3B2026.05 | 15 |