V*
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
V*
86.91Top-1 Accuracy
13
V*
89.5Avg@8 Overall
13
V* Relative Position 52
89.47Accuracy
13
V* Direct Attributes 52
90.43Accuracy
13
V*
80.23Accuracy
13
V*
78.8Accuracy
13
V*
88.9Accuracy
12
V*
94.24Accuracy
11
V*
90Overall Score
11
V* (test)
92.2Overall Score
11
V* (test)
86.9Accuracy
11
V*
0.832Accuracy
10
V*
92.7Accuracy
10
V* bench (test)
87Attribute Rate
10
V*
88.7Pass@1 Score
9
V* (test)
82.2Accuracy
9
V
80Structural F1
9
V142 synthetic
94.75R@1
8
V* (test)
79.05Accuracy
8
V* (test)
84.25Accuracy
8
V*
89Accuracy
8
V*
84.3Accuracy
8
V*
89.8Accuracy
8
V
100Precision of Delay (POD)
7
V*
89.5Pass@1
7