MMBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMBench v1.0 (dev)
69.2MMB^dev Score
15
MMBench en (dev)
90.3Accuracy
15
MMBench (T)
79.1Accuracy (MMBench T)
15
MMBench (dev)
73.5Accuracy
15
MMBench
89.97Class Accuracy
14
MMBench
4.44ECE
14
MMBench OOD
99.84Accuracy
14
MMBench OOD
0.16FPR
14
MMBench CN
64.7Overall Score
14
MMBench v1.0 (test)
67.7Accuracy
14
MMBench EN
83.9Accuracy
13
MMBench Chinese (val)
82.4Accuracy
13
MMBench English (val)
80.2Accuracy
13
MMBench (dev)
69.2MMB Score (dev)
13
MMBench en
54MMBench Score
13
MMBench
83.6MMBench Score
13
MMBench EN (test)
32MMBenchEN Score
13
MMBench-CN (dev)
73Accuracy
13
MMBench (dev)
77.3Accuracy
13
MMBench en cn
62.6MMBench English Score
13
MMBench EN V11 (dev)
84.3Pass@1
13
MMBench 2024c (dev)
83.3Accuracy
13
MMBench en 2024 (dev)
85Score
12
MMBench EN 1.0
86Score
12
MMBench-Video
1.46TR Score
12