MMSI-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
MMSI-Bench
49.5Average Accuracy
67
MMSI-Bench
97.2Accuracy
65
MMSI-Bench
97.2Accuracy
44
MMSI-Bench (test)
52.8PR Score
29
MMSI-Bench (test)
43Cam-Cam Accuracy
25
MMSI-Bench
45.9Accuracy
21
MMSI-Bench MindJourney Subset (162 questions) (test)
0.358Accuracy
19
MMSI-Bench
42.7Overall Accuracy
17
MMSI-Bench
48Score
16
MMSI-Bench 500 QA 1.0
41Accuracy
15
MMSI-Bench 68 (test)
69.4Average Score
12
MMSI-Bench
40.7Accuracy
12
MMSI-Bench 79 (MV)
43.3Accuracy
11
MMSI-Bench
54.3MSR Score
6
MMSI-Bench
36.9Accuracy
6
MMSI-Bench 500 QA pairs
41Accuracy
5
MMSI-Bench 500 QA subset
35.3Accuracy
5
MMSI-Bench
40.8Score
4
MMSI Bench 1.0 (test)
33.3Avg Multiple Choice Accuracy
4
MMSI-Bench
36.6Cam-Cam Accuracy
4
MMSI-Bench
31.5Accuracy
3