SimplerEnv
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SimplerEnv
56Sim. Score
5
SimplerEnv-WidowX+Bridge
91.7Grasp Success Rate
5
SimplerEnv WidowX+Bridge
52.8Grasp Success Rate
5
SimplerEnv WidowX+Bridge
77.8Grasp Spoon Success Rate
5
SimplerEnv WidowX GR00T (simulation)
72Success Rate (Carrot)
4
SimplerEnv Google Robot GR00T (simulation)
82Close Success Rate
4
SimplerEnv Fractal Dataset Google Robot (test)
98.5Success Rate: Pick Coke Can
4
SimplerEnv Bridge Dataset WidowX Robot (test)
67WidowX Spoon on Towel Success Rate
4
SimplerEnv WidowX In-domain Visual Matching setting
78.3Success Rate (Spoon on Towel)
4
SimplerEnv Google Robot
52.3Success Rate
4
SimplerEnv Google Robot variant
37.5Success Rate
4
SimplerEnv Google Robot (match)
59.7Success Rate
4
SimplerEnv Google Robot variant
73Success Rate
4
SimplerEnv Google Robot (match)
76Success Rate
4
SimplerEnv Google Robot (variant)
85.5Success Rate
4
SimplerEnv Google Robot match
83.7Success Rate
4
SimplerEnv Variant Aggregation
80Pick Coke Can Success Rate
3
SimplerEnv Visual Matching
83Pick Coke Can Success Rate
3
EO1 in SimplerEnv (test)
36.7Failure Rate
3
SimplerEnv
48.9Success Rate
3
SimplerEnv WidowX Robot Simulated evaluation spatialvla-4b
1Success Rate (w/o)
3
SimplerEnv WidowX Robot spatialvla-4b (Simulated evaluation)
29.2Success Rate (w/o)
3
SimplerEnv WidowX Robot Simulated evaluation spatialvla-4b
25Success Rate (w/o)
3
SimplerEnv WidowX Robot Simulated evaluation spatialvla-4b
16.7Success Rate (w/o)
3
SimplerEnv Google Robot
86.7Success Rate
2