Real-world
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Real-world (test)
90Success Rate
3
Real-world (test)
10Success Rate
3
Real-world cluttered L2 (test)
90Grasp Success Rate
3
Real-world single L2 (test)
98Grasp SR
3
Real-world single L1 (test)
98Grasp Success Rate (SR)
3
Real-world cluttered L2
90Grasp Success Rate
3
Real-world single L2
98Grasp Success Rate
3
Real-world single L1
98Grasp Success Rate
3
Real-world University Building
30Success Rate (SR)
3
Real-world 25 objects
72Success Rate (Small)
3
Real-world Tidy up the desk
90Success Rate: Open
3
Real-world Arrange the tableware
100Ordered Success Rate
3
Real-world (Unseen)
60Grab Success Rate
3
Real-world (Seen)
65Grab Success Rate
3
Real-World 8 Tasks
95.2Success Rate (%)
3
Real-world Unseen Views (test)
80Success Rate (View 1)
3
Real-world Unseen Views (test)
70Success Rate (View 1)
3
Real-world Unseen Lighting
80Success Rate (Step 1)
3
Real-world (Visual Distraction)
85Success Rate (Step 1)
3
Real-world Random Localization
70Success Rate (Step 1)
3
Real-world Mobile Robot Platform (test)
76Success Rate
3
Real-world Mobile Robot Platform (test)
68Success Rate
3
Real-world SE(3) layout variations 1.0 (test)
2,000Success Rate
3
Real-world SE(3) layout variations 1.0 (test)
20Success Rate
3
Real-world SE(3) layout variations 1.0 (test)
60Success Rate
3