Audio Understanding on MMAU (Perception and Reasoning)
78.64Perception ScoreEvA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EvASetting=Zero-shot2026.03 | 78.64 | 67.35 | |
| Audio-Flamingo-3Setting=Zero-shot2026.03 | 76.78 | 74 | |
| Qwen2.5-Omni-7BSetting=Zero-shot2026.03 | 73.99 | 69.57 | |
| R1-AQASetting=Zero-shot2026.03 | 73.07 | 65.29 | |
| Step-Audio-2-miniSetting=Zero-shot2026.03 | 69.97 | 71.62 | |
| Kimi-Audio-7B-InstructSetting=Zero-shot2026.03 | 67.8 | 62.19 | |
| Audio-ReasonerSetting=Zero-shot2026.03 | 66.56 | 65.73 |