Robotic Manipulation on WidowX
100Spoon Success RateX-VLA
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| X-VLAModel Size Class=Tiny Models (< 1B)2026.02 | 100 | 91.7 | 95.8 | 95.8 | 95.8 | |
| SimVLAModel Size Class=Tiny Models (< 1B)2026.02 | 100 | 91.7 | 91.7 | 100 | 95.8 | |
| MemoryVLAModel Size Class=Large Models (≥ 4B)2026.02 | 75 | 75 | 37.5 | 100 | 71.9 | |
| FLOWERModel Size Class=Small Models (< 4B)2026.02 | 71 | 13 | 8 | 88 | 45 | |
| GR00T-N1Model Size Class=Small Models (< 4B)2026.02 | 62.5 | 45.8 | 16.7 | 20.8 | 49.5 | |
| ThinkActModel Size Class=Large Models (≥ 4B)2026.02 | 58.3 | 37.5 | 8.7 | 70.8 | 43.8 | |
| FPC-VLAModel Size Class=Large Models (≥ 4B)2026.02 | 58.3 | 45.8 | 79.2 | 75 | 64.6 | |
| Octo-SmallModel Size Class=Small Models (< 4B)2026.02 | 47.2 | 9.7 | 4.2 | 56.9 | 43.9 | |
| DD-VLAModel Size Class=Large Models (≥ 4B)2026.02 | 29.2 | 29.2 | 20.8 | 70.8 | 54.2 | |
| RoboVLMModel Size Class=Large Models (≥ 4B)2026.02 | 29.2 | 25 | 12.5 | 58.3 | 38.5 | |
| π0Model Size Class=Small Models (< 4B)2026.02 | 29.1 | 0 | 16.7 | 62.5 | 40.1 | |
| π0-FASTModel Size Class=Small Models (< 4B)2026.02 | 29.1 | 21.9 | 10.8 | 66.6 | 48.3 | |
| SpatialVLAModel Size Class=Large Models (≥ 4B)2026.02 | 16.7 | 25 | 29.2 | 100 | 42.7 | |
| Octo-BaseModel Size Class=Large Models (≥ 4B)2026.02 | 12.5 | 8.3 | 0 | 43.1 | 31.3 | |
| OpenVLA-OFTModel Size Class=Large Models (≥ 4B)2026.02 | 12.5 | 4.2 | 8.3 | 37.5 | 39.6 | |
| RT-1-XModel Size Class=Large Models (≥ 4B)2026.02 | 0 | 4.2 | 0 | 0 | 6.3 | |
| OpenVLAModel Size Class=Large Models (≥ 4B)2026.02 | 0 | 0 | 0 | 4.1 | 7.8 |