Audio Understanding on MMAU (test-mini)
84.04Sound ScoreStep-Audio 2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Step-Audio 2Params=32B2026.02 | 84.04 | 73.56 | 75.15 | 77.58 | |
| Step-Audio 2Model Category=Large Audio Reasoning Models2026.02 | 84.04 | 73.56 | 75.15 | 77.58 | |
| Audio-ThinkerModel Category=Large Audio Reasoning Models2026.02 | 81.98 | 74.25 | 76.88 | 77.7 | |
| Omni-R1Model Category=Large Audio Language Models2026.02 | 81.7 | 73.4 | 76 | 77 | |
| MiMo-AudioParams=7B2026.02 | 81.68 | 74.25 | 68.17 | 74.7 | |
| MiMo-AudioModel Category=Large Audio Language Models2026.02 | 81.68 | 74.25 | 68.17 | 74.7 | |
| GaMMA-14Bzero-shot=true, parameters=14B2026.05 | 79.9 | 74 | 73.6 | 75.8 | |
| Gemini-3.0 Prozero-shot=true2026.05 | 79.6 | 72.2 | 83.5 | 78.4 | |
| Audio-Flamingo3zero-shot=true2026.05 | 79.6 | 74 | 66.4 | 73.3 | |
| Audio Flamingo 3Params=7B2026.02 | 79.58 | 73.95 | 66.37 | 73.3 | |
| Audio Flamingo 3Model Category=Large Audio Reasoning Models2026.02 | 79.58 | 73.95 | 66.37 | 73.3 | |
| Step-Audio 2 miniParams=7B2026.02 | 79.3 | 68.44 | 68.16 | 72.73 | |
| MPAR²-7B2026.02 | 79.2 | 72.8 | 75.1 | 75.7 | |
| Covo-AudioParams=7B2026.02 | 78.68 | 76.05 | 71.17 | 75.3 | |
| Qwen3-OmniSize=30B-A3B2026.01 | 78.68 | 69.46 | 69.37 | 72.5 | |
| Qwen2.5-OmniParams=7B2026.02 | 78.1 | 65.9 | 70.6 | 71.5 | |
| Qwen2.5-Omni-7BModel Category=Large Audio Language Models2026.02 | 78.1 | 65.9 | 70.6 | 71.5 | |
| Qwen2.5-Omnizero-shot=true2026.05 | 78.1 | 65.9 | 70.6 | 71.5 | |
| MPAR2Model Size=7B2026.02 | 77.98 | 71.3 | 74.47 | 74.59 | |
| MPAR2Model Size=3B2026.02 | 76.42 | 65.11 | 69.04 | 70.17 | |
| GaMMA-8Bzero-shot=true, parameters=8B2026.05 | 76.3 | 73.7 | 64 | 71.3 | |
| DIFFA-2Size=8B2026.01 | 76.28 | 63.47 | 69.06 | 69.6 | |
| Kimi-Audiozero-shot=true2026.05 | 75.7 | 66.8 | 62.2 | 68.2 | |
| Kimi-AudioParams=7B2026.02 | 75.68 | 66.77 | 62.16 | 68.2 | |
| Kimi-AudioSize=7B2026.01 | 75.68 | 66.77 | 62.16 | 68.2 | |
| Kimi-AudioModel Category=Large Audio Language Models2026.02 | 75.68 | 66.77 | 62.16 | 68.2 | |
| DIFFA-2Size=8B, factor-based parallel decoding=true2026.01 | 75.38 | 61.08 | 68.47 | 68.3 | |
| Gemini-2.5 Prozero-shot=true2026.05 | 75.1 | 68.3 | 71.5 | 71.6 | |
| Gemini 2.5 Pro2026.02 | 75.08 | 68.26 | 71.47 | 71.6 | |
| Gemini 2.5 Flash2026.02 | 73.27 | 65.57 | 76.58 | 71.8 | |
| Gemini 2.5 FlashModel Category=Commercial Models2026.02 | 73.27 | 65.57 | 76.58 | 71.8 | |
| Qwen2.5-OmniSize=7B2026.01 | 72.97 | 61.68 | 60.96 | 65.2 | |
| Audio Flamingo 2Params=3.2B2026.02 | 71.47 | 70.96 | 44.74 | 62.4 | |
| MiniCPM-OSize=8B2026.01 | 71.47 | 65.57 | 63.06 | 66.7 | |
| Gemini 2.0 Flash2026.02 | 71.17 | 65.27 | 75.08 | 70.5 | |
| Gemini 2.0 Flash2026.01 | 71.17 | 65.27 | 75.08 | 70.5 | |
| Qwen2.5-OmniModel Size=3B2026.02 | 70.27 | 60.48 | 59.16 | 63.3 | |
| Qwen2.5-OmniModel Size=7B2026.02 | 69.4 | 66.8 | 61.6 | 65.9 | |
| Audio-ReasonerModel Category=Large Audio Reasoning Models2026.02 | 67.87 | 69.16 | 66.07 | 67.7 | |
| Qwen2-Audiozero-shot=true2026.05 | 67.3 | 56.3 | 55.3 | 59.6 | |
| Qwen2-Audio-InstructParams=8.4B2026.02 | 67.27 | 56.29 | 55.26 | 59.6 | |
| Qwen2-AudioSize=8B2026.01 | 67.27 | 56.29 | 55.26 | 59.6 | |
| Qwen2-Audio-InstructModel Category=Large Audio Language Models2026.02 | 67.27 | 56.29 | 55.26 | 59.6 | |
| Phi-4-multimodalSize=8B2026.01 | 65.47 | 64.37 | 67.27 | 65.7 | |
| GPT-4o Audiozero-shot=true2026.05 | 64.6 | 56.3 | 66.7 | 60.8 | |
| GPT-4o Audio2026.02 | 64.56 | 56.29 | 66.67 | 62.5 | |
| GPT-4o-Audio2026.01 | 64.56 | 56.29 | 66.67 | 62.5 | |
| GPT-4o AudioModel Category=Commercial Models2026.02 | 64.56 | 56.29 | 66.67 | 62.5 | |
| Qwen-Audio-ChatSize=8B2026.01 | 55.25 | 44 | 30.03 | 43.1 | |
| GPT-4o mini Audio2026.02 | 50.75 | 39.22 | 69.07 | 53 | |
| DIFFASize=8B2026.01 | 46.25 | 43.41 | 59.46 | 49.71 | |
| SalmonnSize=7B2026.01 | 41.14 | 37.13 | 26.43 | 34.9 | |
| SALMONNzero-shot=true2026.05 | 41.1 | 37.1 | 26.4 | 34.9 | |
| LTUSize=7B2026.01 | 20.42 | 15.97 | 15.92 | 17.44 |