MMMU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMMU-Pro
68.1Accuracy
6
MMMU (val)
82Accuracy
6
MMMU (val)
17.68Performance Gain Sum
6
MMMU
0.875Kendall τ
5
MMMU
55.44Score
5
MMMU-Pro
39RC-Acc
5
MMMU
57.8RC-Acc
5
MMMU (test)
62.9Final Performance
5
MMMU Pro
81Score
5
MMMU
1,797.4Prefill Latency (ms)
5
MMMU
51.3Accuracy
5
MMMU-Pro
44.72Accuracy@1
5
MMMU Pro
81Score
5
MMMU-P
34.05MMMU-P Score
4
MMMU
68.6Accuracy
4
MMMU-Pro Vision
56.3Accuracy
4
MMMU-Pro standard 10
19.9Score
4
MMMU Med (val)
87.53Pass@1
4
MMMU
34.1Accuracy
4
MMMU (val)
44.56Accuracy
3
MMMU-Pro(V)
37.23Accuracy
3
MMMU
36.6Top-1 Score
3
MMMU-Pro
44.7Accuracy
3
MMMU
56.8Accuracy (MMMU)
3
MMMU
56.48MMMU Score
3