Omni-modal reasoning on MMAU mini v05.15.25 (test)
75.5Overall ScoreThinkOmni
Evaluation Results
| Method | Links | |
|---|---|---|
| ThinkOmniBase Model=Qwen2.5-Omni-7B, LRM Guide=Qwen32026.02 | 75.5 | |
| ThinkOmniBase Model=Omni-R1-7B, LRM Guide=Qwen32026.02 | 75.4 | |
| HumanOmniV2Notes=Evaluated using authors' scripts2026.02 | 75.3 | |
| ThinkOmniBase Model=Qwen2.5-Omni-7B, LRM Guide=DeepSeek2026.02 | 73.8 | |
| ThinkOmniBase Model=Omni-R1-7B, LRM Guide=DeepSeek2026.02 | 73.1 | |
| Qwen2.5-Omni-7B2026.02 | 71.5 | |
| ThinkOmniBase Model=Qwen2.5-Omni-3B, LRM Guide=Qwen32026.02 | 70.6 | |
| Gemini-2.0-Flash2026.02 | 70.5 | |
| Omni-R1Notes=Evaluated using authors' scripts2026.02 | 70.5 | |
| Omni-R12026.02 | 70.5 | |
| Ola2026.02 | 70.3 | |
| ThinkOmniBase Model=Qwen2.5-Omni-3B, LRM Guide=DeepSeek2026.02 | 70.1 | |
| Qwen2.5-Omni-3B2026.02 | 69.4 | |
| Baichuan-Omni-1.52026.02 | 66.2 | |
| GPT-4o2026.02 | 62.5 |