Simulation Benchmark
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Simulation Benchmark
68Retrieve Object Success Rate (Spatial)
8
Simulation Benchmark
61Goal Reached Rate
8
simulation benchmark
21.2NIR
7
Simulation Benchmark unseen tools
30SR (Scoop S01)
4
Simulation Benchmark Overall OOD
71Success Rate
4
Simulation Benchmark Overall ID
63Success Rate
4
Simulation Benchmark PrepareTable OOD
72Success Rate
4
Simulation Benchmark PrepareTable S1
60Success Rate
4
Simulation Benchmark HangMugTree OOD
60Success Rate
4
Simulation Benchmark PourInBowl OOD
80Success Rate
4
Simulation Benchmark PourInBowl S2
56Success Rate
4
Simulation Benchmark Level 4
131.4TFT (s)
4
Simulation Benchmark Level 3
95Time to First Touch (s)
4
Simulation Benchmark Level 2
133.9TFT (s)
4
Simulation Benchmark Level 1
83.5TFT (s)
4