MMSU
Benchmarks
TaskDatasetSOTA resultTrendResults
MMSU
55.7Perception Score
37
MMSU
81.3Accuracy
35
MMSU
77.7Score
31
MMSU
71.6Accuracy
23
MMSU All (test)
75.2Accuracy
20
MMSU Paralinguistic subset (test)
65.18Accuracy
20
MMSU 1.0 (test)
72.13Perception Semantics
16
MMSU
83.7Score
15
MMSU (test)
66.64Overall Score
15
MMSU
79.36MMSU Score
14
MMSU Paralinguistic
54.51Para. Score
12
MMSU
67.1Accuracy
11
MMSU (test)
77Performance
11
MMSU S→T only
43.2Accuracy
9
MMSU
57.63Acc
8
MMSU
62.2MMSU Reasoning Score
7
MMSU
70.7Accuracy (Audio Reasoning)
7
MMSU
67.79Perception Score (Linguistic)
4