Bimanual Manipulation on Bimanual Manipulation Tasks (new placements + novel instances) (OOD test)
65Plugging Success Rate (OOD)VLBiMan
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VLBiManDynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 65 | 55 | 55 | 50 | 60 | 50 | 55.8 | |
| ReKep+Dynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 25 | 10 | 15 | 10 | 15 | 5 | 13.3 | |
| ReKepDynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 15 | 5 | 5 | 5 | 5 | 0 | 5.8 | |
| MAGICDynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 5 | 10 | 0 | 5 | 5 | 0 | 4.2 | |
| MechanismsDynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Robot-ABCDynamic Interference=Yes, Uneven Lighting=Yes2025.09 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |