Robotic Manipulation on SimplerEnv WidowX Robot Tasks
95.8Grasp Success Rate (Spoon/Towel)GAE
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GAE2025.10 | 95.8 | 79.2 | 76.8 | 57.4 | 93 | 72.1 | 100 | 91.7 | 75.1 | 91.4 | |
| GR00T-N12025.10 | 83.3 | 62.5 | 70.8 | 16.7 | 54.2 | 45.8 | 41.7 | 20.8 | 36.5 | 49.5 | |
| Octo-Small2026.04 | 77.8 | 47.2 | 27.8 | 9.7 | 40.3 | 4.2 | 87.5 | 56.9 | 30 | — | |
| UniVLA2025.10 | 76.4 | 52.8 | 79.2 | 55.6 | 66.7 | 2.8 | 87.5 | 66.7 | 45.6 | 77.5 | |
| π0-FAST2025.10 | 62.5 | 29.1 | 54 | 10.8 | 58.5 | 21.9 | 83.3 | 66.6 | 32.1 | 48.3 | |
| SoFAR2025.10 | 62.5 | 58.3 | 75 | 66.7 | 91.7 | 70.8 | 66.7 | 37.5 | 58.3 | 74 | |
| RoboVLMEvaluation Protocol=fine-tuning2026.04 | 54.2 | 29.2 | 25 | 25 | 45.8 | 12.5 | 58.3 | 58.3 | 31.3 | — | |
| π02025.10 | 45.8 | 29.1 | 50 | 16.7 | 25 | 0 | 91.6 | 62.5 | 27.1 | 40.1 | |
| ReFineVLA2026.04 | 42.9 | 38.1 | 33.3 | 33.3 | 71.4 | 23.8 | 100 | 95.2 | 47.7 | — | |
| RoboVLMEvaluation Protocol=zero-shot2026.04 | 37.5 | 20.8 | 33.3 | 25 | 8.3 | 8.3 | 0 | 0 | 13.5 | — | |
| Octo-Base2026.04 | 34.7 | 12.5 | 52.8 | 8.3 | 31.9 | 0 | 66.7 | 43.1 | 16 | — | |
| Octo-Base2025.10 | 34.7 | 12.5 | 52.8 | 8.3 | 31.9 | 0 | 66.7 | 43.1 | 16 | 46.5 | |
| SpatialVLAEvaluation Protocol=zero-shot2026.04 | 25 | 20.8 | 41.7 | 20.8 | 58.3 | 25 | 79.2 | 70.8 | 34.4 | — | |
| SpatialVLA2025.10 | 25 | 20.8 | 41.7 | 20.8 | 58.3 | 25 | 79.2 | 70.8 | 34.4 | 51.1 | |
| SpatialVLAEvaluation Protocol=fine-tuning2026.04 | 20.8 | 16.7 | 29.2 | 25 | 62.5 | 29.2 | 100 | 100 | 42.7 | — | |
| RT-1-X2026.04 | 16.7 | 0 | 20.8 | 4.2 | 8.3 | 0 | 0 | 0 | 1.1 | — | |
| RT-1-X2025.10 | 16.7 | 0 | 20.8 | 4.2 | 8.3 | 0 | 0 | 0 | 1.1 | 11.5 | |
| OpenVLA2026.04 | 4.1 | 0 | 33.3 | 0 | 12.5 | 0 | 8.3 | 4.1 | 1.1 | — | |
| OpenVLA2025.10 | 4.1 | 0 | 12.5 | 0 | 33 | 0 | 8.3 | 4.1 | 1.1 | 7.8 |