Robotic Manipulation on SimplerEnv WidowX (test)
87.5Put Spoon Success Rate3DThinkVLA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| 3DThinkVLA2026.06 | 87.5 | 75 | 33.3 | 95.8 | 72.9 | |
| VITA2026.06 | 84.2 | 68.8 | 37.5 | 95.6 | 71.5 | |
| QDepth-VLA2026.06 | 82 | 57.5 | 39.6 | 95 | 68.5 | |
| Open pi02026.06 | 73.7 | 61.3 | 15.8 | 89.6 | 60 | |
| FALCON2026.06 | 62.5 | 41.7 | 20.8 | 100 | 56.3 | |
| UD-VLA2025.11 | 58.3 | 62.5 | 54.1 | 75 | 62.5 | |
| F12025.11 | 50 | 70.8 | 50 | 66.7 | 59.4 | |
| Octo2025.11 | 47.2 | 9.7 | 4.2 | 56.9 | 29.5 | |
| RoboVLMs2025.11 | 45.8 | 20.8 | 4.2 | 79.2 | 37.5 | |
| RoboVLM2026.06 | 45.8 | 20.8 | 4.2 | 79.2 | 37.5 | |
| UniVLA2026.06 | 33.3 | 83.3 | 95.8 | 66.7 | 69.8 | |
| π02025.11 | 29.1 | 0 | 16.7 | 62.5 | 40.1 | |
| π0-FAST2025.11 | 29.1 | 21.9 | 10.8 | 66.6 | 48.3 | |
| SpatialVLA2025.11 | 16.7 | 25 | 29.2 | 100 | 42.7 | |
| SpatialVLA2026.06 | 16.7 | 25 | 29.2 | 100 | 42.7 | |
| OpenVLA-OFT2025.11 | 12.5 | 4.2 | 8.3 | 37.5 | 39.6 | |
| Octo2026.06 | 12.5 | 8.3 | 0 | 43.1 | 16 | |
| OpenVLA2025.11 | 0 | 0 | 0 | 4.1 | 1 | |
| RT-1-X2025.11 | 0 | 4.2 | 0 | 0 | 1.1 | |
| OpenVLA2026.06 | 0 | 0 | 0 | 4.1 | 1 |