MMMU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMMU Pro-10c
35.2Accuracy
7
MMMU Pro
81Pass@1
7
MMMU
87Pass@1
7
MMMU Pro
46.23Score
7
MMMU Pro 4
62.03Accuracy@1
7
MMMU Pro (train)
57.83Success Rate (SR)
7
MMMU Pro (test)
54.43Success Rate
7
MMMU (test)
67.78Accuracy
7
MMMU
53.22MMMU Score
7
MMMUPro
44.65Prism
7
MMMU
0.96Spearman Correlation (10% Subset)
7
MMMU
41.89MMMU Score
7
MMMU-Pro overall
51.9Score
7
MMMU (val)
70.2Score
7
MMMU
59Accuracy
7
MMMU pro full
51.2Score
6
MMMU pro full
33.74STEM MMMU-Pro Score
6
MMMU Science 1.0 (val)
36.48Accuracy
6
MMMU
5.6Gain Score
6
MMMU (val)
76.9STEM Reasoning Score
6
MMMU
42.8Overall Score
6
MMMU
87Pass@1 Score
6
MMMU Video
48.8Original Score
6
MMMU out-of-distribution
56.55Accuracy
6
MMMU
16.4FISI F1 Score
6