MMVU
Benchmarks
TaskDatasetSOTA resultTrendResults
MMVU
78.2Accuracy
91
MMVU
75.8Accuracy
71
MMVU
58.5Accuracy
51
MMVU mc
82.6Score
32
MMVU Multiple-choice (test)
75.4Accuracy
25
MMVU
75.4Accuracy
20
MMVU (val)
68.3Average Score
19
MMVU
68.6Accuracy
18
MMVU
68.5Score
12
MMVU Multiple Choice
65.4Accuracy
12
MMVU (test)
68.5Accuracy
9
MMVU mc
75.4Accuracy
9
MMVU (val)
46Score
9
MMVU
75.4Accuracy
7
MMVU (test)
75.96Accuracy
7
MMVU MC
75.4Accuracy
7
MMVU
67Score
6
MMVU
67.2M-Avg
5
MMVU
2.14Throughput (it/s)
3