MMAU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMAU Music (Noise)
85GSR
15
MMAU Music (Clean)
99GSR
15
MMAU
80.4Overall Score
14
MMAU Mini
86.31Sound Score
13
MMAU (test)
74.77Performance
12
MMAU
77.6ACC
11
MMAU Speech mini
75.08Speech Score
11
MMAU mini 1,000 examples (test)
69.4Accuracy
10
MMAU v05.15.25 (base)
59.73Sound Accuracy
10
MMAU v05.15.25 (mini)
61.86Sound Score
10
MMAU Text instruction
71.47Sound Score
9
MMAU Speech
78.68Accuracy
9
MMAU v05.15.25
79.3Sound Score
9
MMAU-style Complex QA
85.7Accuracy
9
MMAU v05.15.25 (test)
0.737Accuracy
8
MMAU mini v05.15.25 (test)
76.8Accuracy
8
MMAU Pro (test)
59.2Performance
8
MMAU
72.4MMAU Score
7
MMAU-Pro
100AIF Score
7
MMAU
76.5Accuracy
7
MMAU
78.64Perception Score
7
MMAU mini
0.742Sound Score
7
MMAU
80.2Sound Accuracy
6
MMAU mini
73.1Overall Score
6
MMAU-Pro Audio Instruction Following
88.5AIF Score
5