V*
Benchmarks
TaskDatasetSOTA resultTrendResults
V*
96.03Accuracy
72
V*
91.1Overall Accuracy
60
V*
89.53Overall Score
55
V* benchmark
91.1Overall Success Rate
54
V*
92.67Accuracy
53
V*
74.35Accuracy
45
V*
89Score
42
V*
95.7Overall Score
30
V*
83.77Accuracy
29
V* OOD
90Overall Score
20
V* v1.0 (test)
84.35Score
20
V*
91.3Attribute Score
19
V*
93.2Accuracy
18
V* Benchmark
84.4Attr Score
18
V*
89.6Accuracy
17
V*
91.1Average Accuracy
17
V*
86.9Accuracy
16
V*
97.9Pass@4
16
V*
90.2Pass@1
16
V*
87Accuracy
16
V*
72.7Score
15
V20
83.8mIoU
15
V* cross-domain (test)
79.06Accuracy
15
V*
91.1Overall Score
14
V*
95.7Overall Score
13