Vision-Language-Action instruction following on ICBench Spatial Suite (test)
99.6Success Rateπ0.5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| π0.5Contradiction=V42026.03 | 99.6 | -2.2 | |
| π0.5Contradiction=V12026.03 | 95.8 | 1.6 | |
| π0.5Contradiction=V32026.03 | 94.8 | 2.6 | |
| π0.5Contradiction=V22026.03 | 93.6 | 3.8 | |
| OpenVLA-OFTContradiction=V32026.03 | 90.2 | 7.4 | |
| OpenVLA-OFTContradiction=V42026.03 | 88.4 | 9.2 | |
| OpenVLA-OFTContradiction=V12026.03 | 86.4 | 11.2 | |
| OpenVLA-OFTContradiction=V22026.03 | 86.2 | 11.4 | |
| π0Contradiction=V22026.03 | 84.2 | 12.6 | |
| π0Contradiction=V32026.03 | 80.4 | 16.4 | |
| π0Contradiction=V12026.03 | 76.4 | 20.4 | |
| π0Contradiction=V42026.03 | 76.2 | 20.6 |