Robot Manipulation on SimplerEnv Bridge (Grasp and Success Rate Breakdown)
91.7Spoon on Towel Grasp RateCogACT + HAMLET
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CogACT + HAMLETHAMLET=true2025.10 | 91.7 | 75 | 83.3 | 62.5 | 75 | 16.7 | 100 | 100 | 63.5 | |
| CogACT2025.10 | 87.5 | 58.3 | 41.7 | 37.5 | 70.8 | 20.8 | 91.7 | 91.7 | 52.1 | |
| CogACT + Multi-frameMulti-frame=true2025.10 | 83.3 | 50 | 79.2 | 50 | 70.8 | 20.8 | 70.8 | 70.8 | 47.9 | |
| Octo-Small2025.10 | 77.8 | 47.2 | 27.8 | 9.7 | 40.3 | 4.2 | 87.5 | 56.9 | 30 | |
| RoboVLM2025.10 | 54.2 | 29.2 | 25 | 25 | 45.8 | 12.5 | 58.3 | 58.3 | 31.3 | |
| Octo-Base2025.10 | 34.7 | 12.5 | 52.8 | 8.3 | 31.9 | 0 | 66.7 | 43.1 | 16 | |
| SpatialVLA2025.10 | 20.8 | 16.7 | 29.2 | 25 | 62.5 | 29.2 | 100 | 100 | 42.7 | |
| OpenVLA2025.10 | 4.1 | 0 | 33.3 | 0 | 12.5 | 0 | 8.3 | 4.1 | 1 |