SimplerEnv
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SimplerEnv Google Robot setup
86.1Horizontal Laying
10
SimplerEnv WidowX Robot 42 (test)
83.3Grasp Success Rate (Spoon to Towel)
9
SimplerEnv
84.4Success Rate
9
SimplerEnv WindowX
95.8Put Spoon Success
9
SimplerEnv Google Robot tasks (Overall Aggregation)
74.1Overall Average
8
SimplerEnv Bridge
91.7Spoon on Towel Grasp Rate
8
SimplerEnv scenes
96.7Success Rate (%)
8
SimplerEnv Visual Matching
75Spoon Success Rate
8
SimplerEnv Google Robot Evaluation suite
90.7Success Rate (Pick Coke Can)
8
SimplerEnv Google Robot Variant Aggregation
97.2Pick Can Success Rate
7
SimplerEnv Google Robot Visual Matching
99.2Pick Can Success Rate
7
SimplerEnv
65.2WidowX Score
7
SimplerEnv Google Robot tasks - Overall
71.8Average Success
7
SimplerEnv WidowX + Bridge
0.137MMRV
7
SimplerEnv Google Robot
0.023MMRV
7
SimplerEnv GoogleRobot (out-of-domain)
100Success Rate (Pick Coke Can)
6
SimplerEnv WidowX
95.8Success Rate
6
SimplerEnv Google Robot (Overall Aggregation) (test)
47.7Success Rate
6
SimplerEnv Google Robot Variant Aggregation (test)
0.56Success Rate
6
SimplerEnv Google Robot (Variant Aggregation) (test)
60Success Rate
6
SimplerEnv Google Robot Variant Aggregation (test)
56.4Success Rate
6
SimplerEnv Google Robot Visual Matching (test)
52.8Success Rate
6
SimplerEnv Google Robot Visual Matching (test)
55Success Rate
6
SimplerEnv
92.6Pick Coke Can Success Rate
5
SimplerEnv Google
68.7Success Rate
5