Robotic Manipulation on RoboCasa GR1 Tabletop
72.8Average Success RateACE-EGO-0
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ACE-EGO-02026.06 | 72.8 | — | — | — | — | — | — | — | — | 84 | — | — | — | — | — | — | — | 44 | — | — | 90 | — | — | — | — | 68 | — | — | 98 | — | |
| DIAL2026.06 | 70.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ZR-02026.06 | 69.3 | 39 | 47 | 20 | 45 | 59 | 40 | — | 82 | 79 | 92 | 85 | 80 | — | 78 | 87 | 88 | 46 | — | 81 | 81 | 74 | 74 | 50 | — | 82 | 81 | 89 | 85 | — | |
| JoyAI-RA2026.06 | 63.2 | — | — | — | — | — | — | — | — | 46 | — | — | — | — | — | — | — | 14 | — | — | 88 | — | — | — | — | 48 | — | — | 88 | — | |
| JoyAIvariant=RA2026.06 | 63.2 | 84 | 90 | 48 | 84 | 70 | 54 | — | 88 | 46 | 92 | 80 | 36 | — | 76 | 52 | 38 | 14 | — | 82 | 88 | 88 | 62 | 24 | — | 48 | 38 | 46 | 88 | — | |
| ABot-M02026.06 | 58.3 | — | — | — | — | — | — | — | — | 58 | — | — | — | — | — | — | — | 26 | — | — | 68 | — | — | — | — | 54 | — | — | 64 | — | |
| ABotvariant=M02026.06 | 58.3 | 86 | 74 | 48 | 46 | 50 | 66 | — | 70 | 58 | 76 | 66 | 38 | — | 52 | 66 | 60 | 26 | — | 54 | 68 | 64 | 60 | 38 | — | 54 | 48 | 66 | 64 | — | |
| CoRE-VLA2026.07 | 56.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FLARE2026.06 | 55 | — | — | — | — | — | — | — | — | 54 | — | — | — | — | — | — | — | 26 | — | — | 64 | — | — | — | — | 50 | — | — | 76 | — | |
| VP-VLAVLM Integration=Qwen3VL2026.03 | 53.8 | 54 | 72 | 44 | 74 | 34 | 48 | 54.3 | 66 | 54 | 74 | 54 | 56 | 60.8 | 48 | 74 | 70 | 26 | 54.5 | 44 | 66 | 38 | 58 | 24 | 46 | 52 | 44 | 56 | 62 | 53.5 | |
| VPvariant=VLA2026.06 | 53.8 | 54 | 72 | 44 | 74 | 34 | 48 | — | 66 | 54 | 74 | 54 | 56 | — | 48 | 74 | 70 | 26 | — | 44 | 66 | 38 | 58 | 24 | — | 52 | 44 | 56 | 62 | — | |
| QwenOFTVLM Integration=Qwen3VL2026.03 | 48.8 | 30 | 76 | 44 | 44 | 32 | 36 | 43.7 | 50 | 40 | 70 | 54 | 38 | 50.4 | 32 | 58 | 52 | 24 | 41.5 | 44 | 56 | 62 | 54 | 30 | 49.2 | 60 | 50 | 66 | 68 | 61 | |
| Isaac-GR00TModel Version=N1.52026.03 | 48.2 | 54 | 50 | 38 | 60 | 32 | 38 | 45.3 | 38 | 46 | 58 | 62 | 28 | 46.4 | 30 | 60 | 56 | 36 | 45.5 | 52 | 48 | 60 | 52 | 32 | 48.8 | 58 | 44 | 60 | 64 | 56.5 | |
| GR00T-N1.52026.07 | 48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QwenGR00TVLM Integration=Qwen3VL2026.03 | 47.8 | 46 | 80 | 54 | 48 | 28 | 46 | 50.3 | 48 | 40 | 68 | 52 | 56 | 52.8 | 42 | 44 | 48 | 18 | 38 | 38 | 56 | 50 | 36 | 16 | 39.2 | 60 | 50 | 54 | 70 | 58.5 | |
| Isaac-GR00TModel Version=N1.62026.03 | 47.6 | 51.5 | 13 | 8.5 | 14 | 41.5 | 16.5 | 24.2 | 58 | 46.5 | 68.5 | 65 | 46.5 | 56.9 | 58.5 | 57.5 | 63 | 28.5 | 51.9 | 51.5 | 71 | 64.5 | 57 | 31.5 | 55.1 | 57 | 43.5 | 51 | 78.7 | 57.6 | |
| GR00T-N1.62026.06 | 47.6 | — | — | — | — | — | — | — | — | 46.5 | — | — | — | — | — | — | — | 28.5 | — | — | 71 | — | — | — | — | 57 | — | — | 78.7 | — | |
| GR00Tvariant=N1.62026.06 | 47.6 | 51.5 | 13 | 8.5 | 14 | 41.5 | 16.5 | — | 58 | 46.5 | 68.5 | 65 | 46.5 | — | 58.5 | 57.5 | 63 | 28.5 | — | 51.5 | 71 | 64.5 | 57 | 31.5 | — | 57 | 43.5 | 51 | 78.7 | — | |
| GR00T-N1.62026.07 | 47.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QwenPIVLM Integration=Qwen3VL2026.03 | 43.9 | 26 | 62 | 42 | 50 | 42 | 32 | 42.3 | 40 | 46 | 60 | 40 | 44 | 46 | 44 | 52 | 50 | 28 | 43.5 | 34 | 64 | 44 | 50 | 28 | 44 | 52 | 40 | 36 | 48 | 44 | |
| Qwen3PI2026.06 | 43.9 | — | — | — | — | — | — | — | — | 46 | — | — | — | — | — | — | — | 28 | — | — | 64 | — | — | — | — | 52 | — | — | 48 | — | |
| Qwen3PI2026.06 | 43.9 | 26 | 62 | 42 | 50 | 42 | 32 | — | 40 | 46 | 60 | 40 | 44 | — | 44 | 52 | 50 | 28 | — | 34 | 64 | 44 | 50 | 28 | — | 52 | 40 | 36 | 48 | — | |
| Diffusion Policy2026.07 | 40.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| QwenFASTVLM Integration=Qwen3VL2026.03 | 39 | 38 | 44 | 56 | 44 | 14 | 14 | 35 | 54 | 42 | 58 | 58 | 40 | 50.4 | 36 | 38 | 42 | 18 | 33.5 | 28 | 34 | 46 | 36 | 16 | 32 | 52 | 30 | 48 | 50 | 45 |