Real Robot
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Real-robot Scene-D
40Success Rate
2
Real-robot Scene-C
35Success Rate
2
Real-robot Scene-B
70Success Rate
2
Real-robot Scene-A
55Success Rate
2
Real robot Richer semantics Experimental
0.947Instruction Following Success Ratio
2
Real robot Similar-object distractors Experimental
15Instruction Following Success Rate
2
Real Robot OOD 1.0 (test)
60Success Rate
2
Real Robot OOD 1.0 (test)
90Success Rate
2
Real Robot OOD 1.0 (test)
100Success Rate
2
Real Robot Unitree G1 Real-world (test)
74Success Rate
2
Real Robot Unitree G1 (test)
24Success Rate
2
Real Robot Unitree G1 Real-world (test)
26Success Rate
2
Real Robot Franka Emika Panda (OOD:Task4)
80Success Rate (OOD:Task4)
2
Real Robot Franka Emika Panda (OOD Task3)
10Success Rate
2
Real Robot Franka Emika Panda (IND:Task2)
7Success Rate
2
Real Robot (Franka Emika Panda) (IND:Task1)
90Success Rate
2
Real Robot (test)
66.3Success Rate
2
Real Robot OOD Pink (test)
70Success Rate
2
Real Robot In-Distribution (test)
86.3Success Rate
2
Real-robot (test)
83.3Success Rate
2
Real-robot (test)
96.7Success Rate
2
Real-robot Out-of-Distribution 1.0 (test)
60Lid Off Success
2
Real-robot In-Distribution 1.0 (test)
80Lid Off Success Rate
2
Real Robot long-horizon xArm
84Success Rate
2
Real-robot trials
86.96Real Success Rate
1