Knowledge on MMSU (test)
77PerformanceQwen3-Omni-Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-Omni-InstructType=Omni, Size=30B-A3B2026.02 | 77 | |
| Kimi-Audio-7B-InstructType=Audio, Size=7B2026.02 | 61.26 | |
| Qwen2.5-Omni-7BType=Omni, Size=7B2026.02 | 61.22 | |
| Eureka-Audio-InstructType=Ours, Size=1.7B2026.02 | 55.63 | |
| Step-Audio-2-miniType=Audio, Size=8B2026.02 | 55.14 | |
| MiniCPM-oType=Omni, Size=9B2026.02 | 54.55 | |
| Qwen2.5-Omni-3BType=Omni, Size=3B2026.02 | 53.41 | |
| Audio Flamingo 3Type=Audio, Size=8B2026.02 | 47.07 | |
| Ming-Lite-Omni-1.5Type=Omni, Size=19B-A2.8B2026.02 | 47 | |
| Eureka-Audio-BaseType=Ours, Size=1.7B2026.02 | 38.03 | |
| Qwen2-AudioType=Audio, Size=7B2026.02 | 35.75 |