MMAU
Benchmarks
TaskDatasetSOTA resultTrendResults
MMAU
81.1Accuracy
57
MMAU v05.15.25 (test-mini)
84.04Sound Score
54
MMAU v05.15.25 (test)
84.04Sound Score
53
MMAU Pro
100Average Score
42
MMAU mini (test)
78.4Average Accuracy
39
MMAU Sound (SNR=-10dB)
66.83Accuracy
36
MMAU (test)
76.58Speech Score
31
MMAU
77.5Score
28
MMAU-Pro 1.0 (test)
59.5Accuracy
27
MMAU 1.0 (test)
77.4Accuracy
27
MMAU mini v05.15.25 (test)
79.6Sound Accuracy
25
MMAU mini original (test)
80.78Accuracy (Sound Domain)
21
MMAU mini (test)
78.5Accuracy
20
MMAU audio
72.08Sound Score
19
MMAU Music SNR=-10dB
64.82Accuracy
18
MMAU-Pro
61.9Average Score
18
MMAU mini (test)
77.7Average Score
17
MMAU
69.23Speech Score
17
MMAU mini v05.15.25 (test)
75.5Overall Score
15
MMAU
79.8MMAU Score
15
MMAU mini 1.0 (test)
83.48Sound Score
15
MMAU Speech (Noise)
80GSR
15
MMAU Speech (Clean)
99GSR
15
MMAU Sound (Noise)
78.33GSR
15
MMAU Sound (Clean)
99.67GSR
15