MMStar
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMStar
82Accuracy
511
MMStar
69.5Accuracy
177
MMStar
91.9Accuracy
151
MMStar
82Accuracy
143
MMStar
79.2Accuracy
102
MMStar
72.13Accuracy
67
MMStar
65.1Score
56
MMStar
77.5Accuracy
55
MMStar
80.1Accuracy
51
MMStar
69Accuracy
51
MMStar
77.8Score
50
MMStar
76.2Accuracy
36
MMStar (test)
68Accuracy
34
MMStar
69.2Score
32
MMStar
68.3Overall Score
31
MMStar
68.01Average Score
31
MMStar
73.07Accuracy
30
MMStar latest (test)
67.2CP
30
MMStar
75.2Accuracy
29
MMStar
63.9Score
29
MMStar
63.78Accuracy
28
MMStar
71.85Accuracy
27
MMStar
68.33Score
26
MMStar Math
77.2Accuracy
26
MMStar (test)
71.6Accuracy
26