Bimanual Manipulation on RoboTwin Hard setting 2.0 (test)
37Beat Block Hammer SRRDT
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RDTsetting=Hard, rollouts=1002026.02 | 37 | 12 | 4 | 9 | 3 | 32 | 3 | 32 | 4 | 1 | 3 | 17 | 4 | 24 | 4 | 30 | 4 | 1 | 9 | 4 | 11 | 4 | 20 | 5 | 0 | 4 | 15 | 3 | 5 | 3 | 2 | 3 | 16 | 4 | — | |
| RDT2026.05 | 37 | — | — | 8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9 | — | 11 | — | — | — | — | — | 15 | — | — | — | — | — | 14 | — | 4 | |
| π0 + SF2026.05 | 35 | — | — | 7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 41 | — | 33 | — | — | — | — | — | 24 | — | — | — | — | — | 23.8 | — | 3 | |
| OptimusVLAsetting=Hard, rollouts=1002026.02 | 26 | 31 | 1 | 46 | 1 | 35 | 2 | 48 | 1 | 4 | 1 | 37 | 2 | 45 | 1 | 58 | 1 | 2 | 31 | 2 | 32 | 1 | 41 | 2 | 7 | 1 | 16 | 2 | 13 | 1 | 11 | 1 | 30 | 1 | — | |
| π0setting=Hard, rollouts=1002026.02 | 21 | 11 | 5 | 3 | 4 | 24 | 5 | 46 | 2 | 1 | 4 | 45 | 1 | 29 | 3 | 41 | 3 | 3 | 36 | 1 | 22 | 3 | 50 | 1 | 6 | 2 | 23 | 1 | 11 | 2 | 1 | 4 | 23 | 3 | — | |
| π0.5reproduced=true, setting=Hard, rollouts=1002026.02 | 21 | 18 | 2 | 28 | 2 | 29 | 4 | 38 | 3 | 2 | 2 | 30 | 3 | 36 | 2 | 49 | 2 | 3 | 28 | 3 | 25 | 2 | 39 | 3 | 6 | 2 | 11 | 4 | 11 | 2 | 5 | 2 | 24 | 2 | — | |
| π02026.05 | 21 | — | — | 2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 38 | — | 22 | — | — | — | — | — | 23 | — | — | — | — | — | 17.7 | — | 0 | |
| DP2026.05 | 19 | — | — | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 8 | — | 0 | — | — | — | — | — | 1 | — | — | — | — | — | 4.8 | — | 1 | |
| VEGA2026.05 | 11 | — | — | 53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 28 | — | 43 | — | — | — | — | — | 24 | — | — | — | — | — | 30.7 | — | 25 | |
| OFT + SF2026.05 | 10 | — | — | 48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44 | — | 32 | — | — | — | — | — | 20 | — | — | — | — | — | 27.8 | — | 13 | |
| DP3setting=Hard, rollouts=1002026.02 | 8 | 14 | 3 | 0 | 5 | 53 | 1 | 7 | 5 | 0 | 4 | 1 | 5 | 3 | 6 | 6 | 5 | 4 | 0 | 5 | 3 | 5 | 22 | 4 | 1 | 3 | 8 | 5 | 0 | 4 | 0 | 5 | 8 | 5 | — | |
| OpenVLA-OFT2026.05 | 6 | — | — | 46 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 33 | — | 34 | — | — | — | — | — | 8 | — | — | — | — | — | 22.7 | — | 9 | |
| π0 + ROCKET2026.05 | 4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35 | — | — | — | — | — | 21 | — | — | — | — | — | 15 | — | 0 | |
| ACTsetting=Hard, rollouts=1002026.02 | 3 | 4 | 7 | 3 | 4 | 1 | 6 | 0 | 6 | 0 | 4 | 1 | 5 | 6 | 5 | 0 | 6 | 5 | 0 | 5 | 0 | 6 | 0 | 6 | 0 | 4 | 2 | 6 | 0 | 4 | 0 | 5 | 1 | 6 | — | |
| DPsetting=Hard, rollouts=1002026.02 | 0 | 5 | 6 | 0 | 5 | 0 | 7 | 0 | 6 | 0 | 4 | 0 | 6 | 0 | 7 | 0 | 6 | 6 | 0 | 5 | 0 | 6 | 0 | 6 | 0 | 4 | 1 | 7 | 0 | 4 | 0 | 5 | 1 | 6 | — |