MMStar
Benchmarks
TaskDatasetSOTA resultTrendResults
MMStar
72.8Accuracy
25
MMStar
64.3Accuracy (MMStar)
23
MMStar
83.6Score
23
MMStar
69.07Accuracy
22
MMStar
81Accuracy
21
MMStar
83.6Accuracy
21
MMStar
75.7Accuracy (General Reasoning)
20
MMStar
76.6CP Score
20
MMStar
64Accuracy
19
MMStar (test)
63.9Accuracy
19
MMStar
65.2Score
18
MMStar
65.2Accuracy
17
MMStar
62.47Accuracy
17
MMStar (test)
72.7Accuracy
17
MMStar pt-PT
64.7Accuracy
16
MMSTAR
72.3Accuracy
16
MMStar
64.7Accuracy
16
MMstar
67.1Pass@1 Accuracy
16
MMStar
72.6Average Score
16
MMStar
65.9Accuracy (Clean)
16
MMStar
66.49Accuracy
15
MMStar
65.1Accuracy
15
MMStar
68.2Score
15
MMStar
74.7Accuracy
14
MMStar
66.8Accuracy (MMStar General Reasoning)
14