VLABench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VLABench
70Toy Success Rate
5
VLABench In Distribution
88IS Success Rate
5
VLABench official (test)
76Precision Score (Toy)
4
VLABench
54Toy Success Rate
4
VLABench
54SR (Toy)
4
VLABench 5 public tracks v1.0
79.8IS (In-dist)
3
VLABench Track 6
6IF
2
VLABench Track 4
6IF
2
VLABench Track 3
10IF
2
VLABench Track 2
2SB Success Rate
2
VLABench Track 1
20IF
2
VLaBench Track 6
0.46Action Completion (AC)
2
VLaBench Track 4
16AC
2
VLaBench Track 3
18AC
2
VLaBench Track 2
8AC
2
VLaBench Track 1
54Action Completion (AC)
2
VLABench Cross Category
14Add Condiment Success Rate
2