MuirBench
Benchmarks
TaskDatasetSOTA resultTrendResults
MuirBench
77.2Accuracy
112
MuirBench
74.5Score
41
Muirbench (test)
68Accuracy
24
MuirBench (test)
68Accuracy
21
MuirBench
57.14Accuracy
21
MuirBench
78.6Accuracy
19
MUIRBENCH
92.94Difference Reasoning Accuracy
19
MuirBench 142 (test)
86.1Score
19
MuirBench Multi-image Understanding
62.3Accuracy
17
MuirBench
59.6Score
16
MUIRBench
62Accuracy
12
MuirBench
68Accuracy
11
MuirBench
68Accuracy
10
MuirBench
41.4Accuracy
9
MuirBench
59.2Accuracy
8
MUIRBench
81.8Pass@1
7
MuirBench (test)
65.04Overall Score
7
MuirBench
70.7Score
5
MuirBench
45.42Score (%)
4
MuirBench
48.12Score
4
MUIRBench
76.4Accuracy
4
MuirBench
62.3Accuracy
4
MuirBench
73Accuracy
3
MuirBench
41.8Accuracy
2