Robotic Manipulation on LIBERO Object (full)
100Success Rate (SR)BitVLA
Evaluation results
| Method | Links | |
|---|---|---|
| BitVLABackbone=BitNet–SigLIP, na (chunk length)=8, step (ms)=37.85, inf (ms)=235.9, VRAM (MiB)=13122026.06 | 100 | |
| GR00T-N1.7Backbone=Eagle/Cosmos, na (chunk length)=16, step (ms)=10.26, inf (ms)=84.1, VRAM (MiB)=63022026.06 | 98 | |
| GR00T-N1.5Backbone=Eagle/Cosmos, na (chunk length)=16, step (ms)=14.17, inf (ms)=147.0, VRAM (MiB)=48662026.06 | 96 | |
| Evo-1Backbone=InternVL3, na (chunk length)=8, step (ms)=63.60, inf (ms)=131.0, VRAM (MiB)=15642026.06 | 94.5 | |
| SmolVLABackbone=SmolVLM2, na (chunk length)=4, step (ms)=28.16, inf (ms)=54.8, VRAM (MiB)=14102026.06 | 90.5 | |
| π0Backbone=PaliGemma, na (chunk length)=32, step (ms)=9.74, inf (ms)=207.2, VRAM (MiB)=55482026.06 | 87.5 | |
| GR00T-N1.6Backbone=Eagle/Cosmos, na (chunk length)=16, step (ms)=10.29, inf (ms)=83.6, VRAM (MiB)=60482026.06 | 86.5 |