Real-world
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Real-world 1.0 (test)
90Success Rate
4
Real-World
80FWT
4
Real-world
100SR
4
Real-world
4,000Success Rate (SR)
4
Real World
91.43User Preference
4
Real World
0.927User Preference Score
4
Real-world datasets
98.1Realism
4
Real-world 1.0 (test)
100Success Rate
4
Real-world 1.0 (test)
0.224Success Rate
4
Real-world 1.0 (test)
100Success Rate
4
Real-world dataset (test)
3.08ECMS
4
Real-world Sim-to-real
82Success Rate
4
Real-World 50k pts each (4 models)
38Time (s)
4
Real World (unseen environments and tasks)
90Task 1 Success Rate
4
Real-world Position uncertainty, 2 objects, 4 positions
20Success Rate
3
Real-world Shape uncertainty, 8 objects
40Success Rate (SR)
3
Real World Held-out Tasks
29Success Rate
3
Real World Seen Tasks
46Success Rate
3
Real-world (Yahboom DoFbot)
80Success Rate
3
Real-world Yahboom DoFbot
90Success Rate
3
Real-world
70SR
3
Real World 20 trials 1.0 (test)
1Approach Rate
3
Real World 20 trials 1.0 (test)
20Approach Success Rate
3
Real World 20 trials 1.0 (test)
1Approach Success Rate
3
Real-world (test)
0.62Set-Paper-Roll Score
3