Robot Manipulation on LabUtopia Out-of-Distribution
48.3Pick Up Success RateLabVLA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LabVLASize=4B2026.06 | 48.3 | 98.3 | 65.8 | 34.2 | 87.5 | 85.8 | 70 | |
| GR00T N1.5Size=3B2026.06 | 33.3 | 92.5 | 8.3 | 0 | 99.2 | 66.7 | 50 | |
| π0.5Size=3B2026.06 | 30 | 68.3 | 59.2 | 29.2 | 40 | 85.8 | 52.1 | |
| X-VLASize=<1B2026.06 | 27.5 | 99.2 | 59.2 | 25 | 39.2 | 67.5 | 52.9 | |
| π0Size=3B2026.06 | 19.2 | 89.1 | 53.3 | 38.3 | 90.8 | 88.3 | 63.2 | |
| InternVLA-A1Size=3B2026.06 | 19.2 | 95.8 | 63.3 | 0.83 | 84.2 | 57.5 | 53.5 | |
| π0-FASTSize=3B2026.06 | 14.2 | 45 | 15.8 | 7.5 | 11.7 | 24.2 | 19.7 | |
| SmolVLASize=<1B2026.06 | 11.7 | 99.2 | 18.3 | 1.67 | 98.3 | 89.2 | 53.1 | |
| Wall-oss-flowSize=4B2026.06 | 7.5 | 61.7 | 0 | 0 | 0 | 26.7 | 16 |