Vision-Language-Action instruction following on ICBench Goal Suite (test)
96.2Success Rate (SR)π0.5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| π0.5Contradiction=V42026.03 | 96.2 | 1.4 | |
| π0.5Contradiction=V32026.03 | 92.4 | 5.2 | |
| π0.5Contradiction=V12026.03 | 90.2 | 7.4 | |
| π0.5Contradiction=V22026.03 | 82.8 | 14.8 | |
| OpenVLA-OFTContradiction=V22026.03 | 70.2 | 27.8 | |
| OpenVLA-OFTContradiction=V12026.03 | 66.4 | 31.6 | |
| OpenVLA-OFTContradiction=V32026.03 | 64.2 | 33.8 | |
| OpenVLA-OFTContradiction=V42026.03 | 58.4 | 39.6 | |
| π0Contradiction=V12026.03 | 46.4 | 49.4 | |
| π0Contradiction=V32026.03 | 46.2 | 49.6 | |
| π0Contradiction=V22026.03 | 40.2 | 55.6 | |
| π0Contradiction=V42026.03 | 36.4 | 59.4 |