MMAR & MMAU
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMAR & MMAU 1.0 (ALL)
73Pass@1 Accuracy
4
MMAR & MMAU Hardest 1.0 (L5)
38Pass@1 Accuracy
4
MMAR & MMAU L4 Difficult 1.0
54Pass@1 Accuracy
4
MMAR & MMAU L3 Intermediate 1.0
65Pass@1 Accuracy
4
MMAR & MMAU L2 Simple 1.0
91Pass@1 Accuracy
4
MMAR & MMAU L1 - Trivial 1.0
99Pass@1 Acc
4