Robotic Manipulation on SIMPLER Visual Matching
78.1Average Success RateHard-TIES
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Hard-TIESRetained tokens=562026.03 | 78.1 | — | 79.2 | 77.1 | — | — | — | 91.3 | 64.8 | — | — | |
| Soft-TIESRetained tokens=562026.03 | 76.8 | — | 79.6 | 76.9 | — | — | — | 93.3 | 57.4 | — | — | |
| EfficientVLABackbone=CogACT, Sources=Arxiv’252025.11 | 76.13 | — | 82.4 | 70.3 | — | — | — | 95.3 | 56.5 | 1.53 | 44.1 | |
| CogACTUAOR=true, reproduced=true2026.02 | 75.7 | 95 | 87.1 | 73.6 | — | — | 47.2 | — | — | — | — | |
| EfficientVLARetained tokens=562026.03 | 75.5 | — | 82.4 | 69.8 | — | — | — | 94.7 | 55.4 | — | — | |
| CogACTPrecision=FP Model2026.02 | 74.8 | 91.3 | 85 | 71.8 | 50.9 | — | — | — | — | — | — | |
| CogACTFLOPs (%)=100.0, Speedup=1.00×2026.05 | 74.8 | 91.3 | 85 | 71.8 | 50.9 | — | — | — | — | — | — | |
| CogACTBackbone=CogACT, Sources=Arxiv’242025.11 | 74.75 | — | 85 | 71.8 | — | — | — | 91.3 | 50.9 | 1 | 100 | |
| SAFE-PrunerFLOPs (%)=37.4, Speedup=1.73×2026.05 | 74.5 | 91.3 | 83.8 | 70.8 | 51.9 | — | — | — | — | — | — | |
| VLA-CacheRetained tokens=562026.03 | 74.4 | — | 83.3 | 70.5 | — | — | — | 92 | 51.6 | — | — | |
| VLA-CacheFLOPs (%)=80.1, Speedup=1.38×2026.05 | 74.4 | 92 | 83.3 | 70.5 | 51.6 | — | — | — | — | — | — | |
| VLA-CacheBackbone=CogACT, Sources=NeurIPS’252025.11 | 74.35 | — | 83.3 | 70.5 | — | — | — | 92 | 51.6 | 1.47 | 80.1 | |
| FastVRetained tokens=562026.03 | 74.1 | — | 81.4 | 69.8 | — | — | — | 92.6 | 52.4 | — | — | |
| FastVFLOPs (%)=42.0, Speedup=1.21×2026.05 | 74.1 | 92.6 | 81.4 | 69.8 | 52.4 | — | — | — | — | — | — | |
| ActDistillBackbone=CogACT, Sources=Ours2025.11 | 74.08 | — | 82.3 | 70.6 | — | — | — | 91 | 52.4 | 1.67 | 42.3 | |
| CogACTreproduced=true2026.02 | 73.1 | 92.3 | 83.7 | 72.7 | — | — | 43.5 | — | — | — | — | |
| CogACTRetained tokens=562026.03 | 72.7 | — | 83.8 | 72.7 | — | — | — | 91.7 | 42.6 | — | — | |
| MoLe-VLABackbone=CogACT, Sources=Arxiv’252025.11 | 71.9 | — | 80.2 | 70.6 | — | — | — | 86.4 | 50.4 | 1.58 | 46.2 | |
| HBVLAWeight Bit-width=1.08 bit2026.02 | 70 | 86.7 | 81.7 | 71.8 | 38.4 | -4.8 | — | — | — | — | — | |
| HBLLMWeight Bit-width=1.08 bit2026.02 | 62.3 | 80.7 | 81.7 | 64.4 | 22.2 | -12.5 | — | — | — | — | — | |
| BiVLMWeight Bit-width=1.08 bit2026.02 | 57.1 | 76.8 | 62.1 | 52.7 | 16.7 | -17.7 | — | — | — | — | — | |
| RT-12026.02 | 52.4 | 85.7 | 44.2 | 73 | — | — | 6.5 | — | — | — | — | |
| RT-2-X2026.02 | 46.3 | 78.7 | 77.9 | 25 | — | — | 3.7 | — | — | — | — | |
| RT-1-X2026.02 | 42.4 | 56.7 | 31.7 | 59.7 | — | — | 21.3 | — | — | — | — | |
| OpenVLA2026.02 | 34.3 | 18 | 56.3 | 63 | — | — | 0 | — | — | — | — | |
| Full tokensRetained tokens=Full2026.03 | 34.3 | — | — | — | — | — | — | — | — | — | — | |
| BiLLMWeight Bit-width=1.08 bit2026.02 | 28.8 | 37 | 45.8 | 32.4 | 0 | -46 | — | — | — | — | — | |
| TIESRetained tokens=562026.03 | 28.31 | — | — | — | — | — | — | — | — | — | — | |
| FastVRetained tokens=562026.03 | 27.99 | — | — | — | — | — | — | — | — | — | — | |
| RandomFLOPs (%)=58.5, Speedup=1.20×2026.05 | 20.9 | 9.7 | 20.4 | 53.5 | 0 | — | — | — | — | — | — | |
| Octo-base2026.02 | 11 | 17 | 4.2 | 22.7 | — | — | 0 | — | — | — | — |