Vision-Language-Action instruction following on ICBench Object Suite (test)
94.2Success Rate (SR)π0.5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| π0.5Contradiction=V12026.03 | 94.2 | 4.2 | |
| π0Contradiction=V32026.03 | 93.6 | 5.2 | |
| π0.5Contradiction=V22026.03 | 90.4 | 8 | |
| π0Contradiction=V42026.03 | 90.4 | 8.4 | |
| OpenVLA-OFTContradiction=V12026.03 | 88.4 | 10 | |
| π0.5Contradiction=V42026.03 | 88.4 | 10 | |
| π0Contradiction=V12026.03 | 88.2 | 10.6 | |
| OpenVLA-OFTContradiction=V32026.03 | 88.2 | 10.2 | |
| π0.5Contradiction=V32026.03 | 87.6 | 10.8 | |
| π0Contradiction=V22026.03 | 86.4 | 12.4 | |
| OpenVLA-OFTContradiction=V22026.03 | 84.2 | 14.2 | |
| OpenVLA-OFTContradiction=V42026.03 | 82.4 | 16 |