MMMU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMMU
81.8Accuracy
437
MMMU
84.2Accuracy
422
MMMU
71.5Accuracy
249
MMMU
67.8MMMU Score
232
MMMU
83.89Accuracy
220
MMMU (val)
81.7Accuracy
212
MMMU (val)
85.2MMMU Score
211
MMMU Pro
85.6Accuracy
171
MMMU (val)
78.2Accuracy
168
MMMU (test)
69.6MMMU Score
112
MMMU
81.8MMMU Score
110
MMMU
59.63Accuracy
107
MMMU
81.7Accuracy
101
MMMU
82.3Accuracy
98
MMMU
36.1Accuracy
83
Video-MMMU
84.6Accuracy
83
MMMU
72.9Accuracy
77
MMMU
83.4Accuracy (MMMU)
73
MMMU
72.9Accuracy
71
MMMU
60.74MMMU Score
69
MMMU Pro
67.3Accuracy
66
MMMU
85.4Overall Score
57
MMMU
2.3Delta Accuracy
48
MMMU (test)
64.7Accuracy
43
MMMU
85.79Accuracy
40