Robot Manipulation on LabUtopia In-Distribution
49.2Pick Up Success RateLabVLA
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LabVLASize=4B2026.06 | 49.2 | 100 | 65 | 43.3 | 83.3 | 85.8 | 71.1 | |
| GR00T N1.5Size=3B2026.06 | 40.8 | 99.2 | 6.7 | 0 | 99.2 | 69.2 | 52.5 | |
| π0.5Size=3B2026.06 | 38.3 | 60 | 55.8 | 29.2 | 40.8 | 90 | 52.4 | |
| X-VLASize=<1B2026.06 | 27.5 | 98.3 | 65 | 45 | 25.8 | 83.3 | 57.5 | |
| InternVLA-A1Size=3B2026.06 | 25.8 | 93.3 | 38.3 | 2.5 | 82.5 | 67.5 | 51.7 | |
| π0Size=3B2026.06 | 21.7 | 92.5 | 51.6 | 37.5 | 90 | 86.7 | 63.3 | |
| π0-FASTSize=3B2026.06 | 16.7 | 37.5 | 17.5 | 5.8 | 3.3 | 20.8 | 16.9 | |
| SmolVLASize=<1B2026.06 | 15.8 | 97.5 | 16.7 | 0.8 | 96.7 | 85.8 | 52.2 | |
| Wall-oss-flowSize=4B2026.06 | 11.7 | 54.2 | 0.83 | 0 | 0 | 29.2 | 16 |