Audio Understanding on MMAU v05.15.25
79.3Sound ScoreStep Audio2 Mini
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Step Audio2 MiniModel Type=Industry SLM2026.04 | 79.3 | 68.44 | 68.16 | 72.73 | |
| Qwen2.5-Omni-7BModel Type=Industry SLM2026.04 | 78.1 | 65.9 | 70.6 | 71.5 | |
| Qwen3-Omni-30BModel Type=Industry SLM2026.04 | 75.77 | 74.67 | 82.97 | 77.8 | |
| Kimi AudioModel Type=Industry SLM2026.04 | 75.68 | 66.77 | 62.16 | 68.2 | |
| GPT-4o AudioModel Type=Commercial SLM2026.04 | 64.56 | 56.29 | 66.67 | 62.5 | |
| GLM-4-VoiceModel Type=Industry SLM2026.04 | 37.54 | 35.93 | 41.44 | 38.3 | |
| UltraVoice-7BModel Type=Expressive SLM2026.04 | 35.44 | 38.92 | 63.96 | 46.1 | |
| Qwen2.5-Omni-3BModel Type=Industry SLM2026.04 | 30.24 | 49.25 | 39.04 | 39.51 | |
| SA-SLMModel Type=Expressive SLM2026.04 | 29.94 | 49.25 | 39.63 | 39.6 |