SimplerEnv
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SimplerEnv WidowX
83.3Overall Success Rate
123
SimplerEnv Google Robot tasks Variant Aggregation
75.9Average Success Rate
109
SimplerEnv Google Robot Visual Matching
98.7Pick Coke Can
79
SimplerEnv WidowX Robot tasks (test)
89.6Success Rate (Spoon)
79
SimplerEnv Google Robot tasks Visual Matching
98.1Pick Coke Can Success Rate
70
SimplerEnv
87.5Success Rate: Spoon on Towel
60
SimplerEnv WidowX Visual Matching
80.8Average Success Rate
52
SimplerEnv WidowX (test)
79.2Task Success Rate (Spoon on Towel)
41
SimplerEnv
98.7Pick-Can Success Rate
32
SimplerEnv WidowX Robot tasks
9,800Average Success Rate
32
SimplerEnv Bridge
87.5Carrot Success Count
31
SimplerEnv Google Robot - Visual Aggregation
91.6Pick Coke Can
28
SimplerEnv Google Robot embodiment
82Success Rate
28
SimplerEnv Google Robot embodiment
93.3Success Rate
28
SimplerEnv Google Robot embodiment (test)
64Success Rate
28
SimplerEnv Google Robot Tasks Visual Matching and Variant Aggregation
85.7VM - Pick Coke Can Success Rate
27
SimplerEnv WidowX v1 (test)
87.5Spoon Success Rate
24
SimplerEnv WidowX
62.5Success Rate: Put Spoon
23
SimplerEnv
64.6Average Success Rate
23
SimplerEnv Google Robot tasks (test)
85.4Visual Matching (Pick Coke)
22
SimplerEnv OOD
64.5Average Success Rate
21
SimplerEnv WidowX (test)
87.5Put Spoon Success Rate
20
SimplerEnv WidowX Robot Tasks
95.8Grasp Success Rate (Spoon/Towel)
19
SimplerEnv WidowX
97.5Success Rate
18
SimplerEnv WidowX
98Success Rate
18