Simulation-based manipulation data collection on Audited-suite rollout 1.0 (val)
91.2Annotation Coverage (%)AnnotateAnything (grasp subset)
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| AnnotateAnything (grasp subset)Eval. Skills=Grasp2026.06 | 91.2 | 60.3 | 96.4 | 98.1 | 800 | 90.5 | 300 | 1.11 | 90.1 | |
| AnnotateAnything (full)Eval. Skills=All skill families2026.06 | 85.6 | 40.6 | 87.4 | 91.9 | 198 | 86 | 165 | 1.17 | 85.5 | |
| ManiTwin-adaptedEval. Skills=Grasp2026.06 | 80.5 | 55.8 | 82.6 | 87.4 | 95 | 74 | 135 | 1.35 | 78.8 | |
| MOPS-affordance + heuristicEval. Skills=Visual affordance2026.06 | 71 | — | — | — | — | 42.6 | 60 | 2.35 | 62.5 | |
| MolmoBot-adaptedEval. Skills=Grasp, Articulation, Nav.2026.06 | 68.2 | 29.4 | 58 | 64.1 | 34 | 53.5 | 82 | — | 66.8 | |
| GenManip-adaptedEval. Skills=Grasp, Articulation, Insertion2026.06 | 66.5 | 27.8 | 55.4 | 61.5 | 28 | 50.2 | 74 | 1.99 | 64 | |
| RoboGen-adaptedEval. Skills=Grasp, Articulation2026.06 | 59.6 | 22.5 | 45.2 | 54.8 | 18 | 39.5 | 42 | 2.53 | 57 |