MLVU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MLVU (full)
73MLVU Score
7
MLVU m-avg
69.8MLVU m-avg Score
7
MLVU
64.7MLVU Score
7
MLVU MCQ (val)
70.3Score
7
MLVU
70.9Average Score
6
MLVU
75m-avg
6
MLVU
78.1M-Avg
5
MLVU (test)
74Average Inference Time per Sample (s)
5
MLVU
48.82MLVU Score
4
MLVU
80.6TR Accuracy
4
MLVU
2.78Wall-time Speedup
4
MLVU (val)
60.4MLVU-Avg
3