Robot Manipulation (Open/Close Drawer) on SimplerEnv-Fractal (Google Robot)
83.7Success RateMagma
Evaluation results
| Method | Links | |
|---|---|---|
| MagmaEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 83.7 | |
| CogACTEvaluation protocol=Public-context (Transcribed), Source context=CogACT Table 1 [49]2026.06 | 71.8 | |
| GeoAlignEvaluation protocol=Controlled, Source context=ours2026.06 | 70.3 | |
| MolmoActEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38], Mode=zero-shot2026.06 | 66.5 | |
| RGB-only baselineEvaluation protocol=Controlled, Source context=ours2026.06 | 65.8 | |
| MolmoActEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38], Mode=fine-tuned2026.06 | 60 | |
| RT-1-XEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 59.7 | |
| SpatialVLAEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 59.3 | |
| GR00T-N1.5Evaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 35.8 | |
| OpenVLAEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 35.6 | |
| RT-2-XEvaluation protocol=Public-context (Transcribed), Source context=MolmoAct Tbl. 1 [38]2026.06 | 25 |