Real-world Robot Manipulation
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Real-world Robot Manipulation Fundamental v1 (test)
90Success Rate
4
Real-world Robot Manipulation Fundamental v1 (test)
85Success Rate
4
Real-world robot manipulation
0.8Success Rate
4
Real-world robot manipulation
65Success Rate
4
Real-world Robot Manipulation Average Generalization
68.9Success Rate
4
Real-world Robot Manipulation Visual Distractor
53.3Success Rate
4
Real-world Robot Manipulation Lightning Variation
0.667Success Rate
4
Real-world robot manipulation Static (ID)
78Success Rate
3
Real-world robot manipulation Static (ID)
84Success Rate
3
Real-world robot manipulation Static (ID)
82Success Rate
3
Real-world robot manipulation Static (ID)
92Success Rate
3
Real-World Robot Manipulation
60Shut Down Laptop Success Rate
3
Real-world Robot Manipulation Total (test)
2,800Success Rate
2
Real-world Robot Manipulation Hinge Lid (test)
90Success Rate
2
Real-world Robot Manipulation Average across all variations
50Success Rate: Place Shape (Sorter)
2
Real-world Robot Manipulation Light Strength Variation
50Place Shape in Shape Sorter
2
Real-world Robot Manipulation Distracted Objects
0.4Success Rate: Place Shape in Sorter
2
Real-world Robot Manipulation Table Color Variation
50Place Shape Sorter Success Rate
2
Real-world Robot Manipulation No Variation
60Place Shape in Sorter Success
2
Real-world Robot Manipulation Hinge Handle
9Success Rate
2
Real-world Robot Manipulation 1.0 (Light Strip)
—Primary metric
0
Real-world Robot Manipulation 1.0 (AirPods)
—Primary metric
0
Real-world Robot Manipulation 1.0 (Position)
—Primary metric
0
Real-world Robot Manipulation 1.0 (Yogurt)
—Primary metric
0
Real-world Robot Manipulation Drawer 1.0
—Primary metric
0