MMMU-Pro
Benchmarks
TaskDatasetSOTA resultTrendResults
MMMU-Pro offline (test)
51.79Accuracy
38
MMMU-Pro std.
61.3Accuracy
24
MMMU-Pro Vis
57.5Score
11
MMMU-Pro (V)
18.6MMMU-Pro Score
10
MMMU-Pro Vision v1.0 (test)
32Accuracy
5
MMMU-Pro standard
50.7Score
5
MMMU Pro Med
73.88Pass@1
4