Blocks
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Blocks (Extrapolation)
60Coverage
17
Blocks (Interpolation)
100Coverage
17
Blocks (val)
100Coverage
17
Blocks Real-world
95AUCPR
12
Blocks (test)
0.21Execution Time
11
Blocks Vec3 (test)
100Success Rate
9
Blocks Vec3 distribution (train)
100Success Rate
9
Blocks 1.0 (extrapolation)
0.13QS
7
Blocks 1.0 (interpolation)
100QS Score
7
Blocks 1.0 (val)
1QS
7
Blocks (interpolation)
100Normalized Coverage Score
7
blocks
100Coverage
5
Blocks (extrapolation)
1QSS
3
Blocks (val)
1QSS
3
Blocks 3
72Opt
3
Blocks 2
93.7Opt
3
blocks4 (Action traces)
3Intersection Count (|z ∩ x'|)
2
blocks3 (Action traces)
2Intersection Count (|z ∩ x'|)
2
Blocks (aggregated instances 1-3)
86.36Precision
1