Robotic Task Planning on R-Dataset zero-shot
95TSRAIDE
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AIDEClosed-loop=true, Affordance analysis=true, Real-time execution=true, Zero-shot=true2026.02 | 95 | 92 | 91 | 88 | 65 | 9.5 | |
| MOKAClosed-loop=false, Affordance analysis=true, Real-time execution=false, Zero-shot=true2026.02 | 88 | 68.5 | 59 | 54 | — | 0.03 | |
| IntroPlanClosed-loop=false, Affordance analysis=false, Real-time execution=false, Zero-shot=true2026.02 | 87.5 | — | — | — | — | 0.04 | |
| GPT-5Closed-loop=false, Affordance analysis=false, Real-time execution=false, Zero-shot=true2026.02 | 78 | 37 | 45.5 | 33.5 | 10 | 0.04 | |
| RobopointClosed-loop=false, Affordance analysis=false, Real-time execution=true, Zero-shot=true2026.02 | 77.5 | 41.5 | 38.5 | 36.5 | 0 | 0.19 | |
| Qwen3-VLClosed-loop=false, Affordance analysis=false, Real-time execution=false, Zero-shot=true2026.02 | 70 | 31 | 34.5 | 21 | 5 | 0.04 | |
| SayCanClosed-loop=true, Affordance analysis=true, Real-time execution=false, Zero-shot=true2026.02 | 59 | — | — | — | — | 0.03 | |
| MolmoClosed-loop=false, Affordance analysis=false, Real-time execution=false, Zero-shot=true2026.02 | 15.5 | 9.5 | 4 | 1.5 | 0 | 0.05 | |
| MagmaClosed-loop=false, Affordance analysis=false, Real-time execution=true, Zero-shot=true2026.02 | 1 | 0.5 | 0 | 0 | 0 | 0.94 |