Robot Manipulation on LIBERO (Success Rates, Performance Delta, Memory, and Speedup)
97.6Spatial Success RateFP Model
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FP ModelModel=OpenVLA-OFT, Setting=FP2026.06 | 97.6 | 98.4 | 97.9 | 94.5 | 97.1 | — | 15.4 | 1 | |
| Mix-QVLAModel=OpenVLA-OFT, Setting=W8A82026.06 | 97.4 | 98.2 | 96.4 | 94.3 | 96.6 | -0.5 | 6.7 | 1.39 | |
| QVLAModel=OpenVLA-OFT, Setting=W8A82026.06 | 97.2 | 98.2 | 95.8 | 94.3 | 96.4 | -0.7 | 7.2 | 1.36 | |
| Mix-QVLAModel=OpenVLA-OFT, Setting=W4A42026.06 | 96.8 | 97.8 | 96.4 | 94 | 96.3 | -0.8 | 4.1 | 1.52 | |
| SmoothQuantModel=OpenVLA-OFT, Setting=W8A82026.06 | 96.4 | 97.8 | 95.4 | 94.3 | 96 | -1.1 | 7.7 | 1.41 | |
| QVLAModel=OpenVLA-OFT, Setting=W4A42026.06 | 96.2 | 97.6 | 96.4 | 93.8 | 96 | -1.1 | 4.5 | 1.49 | |
| OmniQuantModel=OpenVLA-OFT, Setting=W8A82026.06 | 95.4 | 96.2 | 93 | 92.6 | 94.3 | -2.8 | 8 | 1.3 | |
| OmniQuantModel=OpenVLA-OFT, Setting=W4A42026.06 | 95 | 94.4 | 94 | 92 | 93.9 | -3.2 | 5.7 | 1.37 | |
| QVLAModel=OpenVLA, Setting=W8A82026.06 | 85.2 | 88 | 77.6 | 54.2 | 76.3 | -0.2 | 7.1 | 1.42 | |
| FP ModelModel=OpenVLA, Setting=FP2026.06 | 84.7 | 88.4 | 79.2 | 53.7 | 76.5 | — | 15.2 | 1 | |
| Mix-QVLAModel=OpenVLA, Setting=W8A82026.06 | 84.7 | 88.1 | 78.9 | 53.4 | 76.3 | -0.2 | 6.6 | 1.46 | |
| DyQ-VLAModel=OpenVLA, Setting=W4A42026.06 | 84.7 | 87.8 | 78.5 | 53.4 | 76.1 | -0.4 | 4.7 | 1.51 | |
| Mix-QVLAModel=OpenVLA, Setting=W4A42026.06 | 84.7 | 87.9 | 78.9 | 53.5 | 76.3 | -0.2 | 4 | 1.52 | |
| QVLAModel=OpenVLA, Setting=W4A42026.06 | 84.4 | 87.6 | 78.8 | 53 | 76 | -0.5 | 4.3 | 1.47 | |
| SmoothQuantModel=OpenVLA, Setting=W8A82026.06 | 84.2 | 87.8 | 77.8 | 53.2 | 75.8 | -0.7 | 7.4 | 1.4 | |
| OmniQuantModel=OpenVLA, Setting=W8A82026.06 | 82.6 | 86.2 | 74.8 | 51.7 | 73.8 | -2.7 | 7.8 | 1.26 | |
| OmniQuantModel=OpenVLA, Setting=W4A42026.06 | 82.2 | 85.4 | 75.4 | 50.3 | 73.3 | -3.2 | 5.4 | 1.43 | |
| SmoothQuantModel=OpenVLA-OFT, Setting=W4A42026.06 | 77.2 | 70 | 77.8 | 68.6 | 73.4 | -23.7 | 4.9 | 1.53 | |
| SmoothQuantModel=OpenVLA, Setting=W4A42026.06 | 69.2 | 73.2 | 69.6 | 40.9 | 63.2 | -13.3 | 4.7 | 1.52 |