Embodied Task Planning on Robotouille Asynchronous (test)
86Pass@1 AccuracyGiG+Exp
Evaluation results
| Method | Links | |
|---|---|---|
| GiG+ExpBackbone=DeepSeek, Planning Framework=GiG+Exp, Experience Memory=Yes2026.01 | 86 | |
| GiG+ExpBackbone=Qwen3, Planning Framework=GiG+Exp, Experience Memory=Yes2026.01 | 82 | |
| GiGBackbone=Qwen3, Planning Framework=GiG2026.01 | 72 | |
| GiGBackbone=Gemini, Planning Framework=GiG2026.01 | 66 | |
| GiG+ExpBackbone=Gemini, Planning Framework=GiG+Exp, Experience Memory=Yes2026.01 | 66 | |
| ReActBackbone=Gemini, Planning Framework=ReAct2026.01 | 60 | |
| GiGBackbone=DeepSeek, Planning Framework=GiG2026.01 | 59 | |
| ReCAPBackbone=Qwen3, Planning Framework=ReCAP2026.01 | 35 | |
| ReActBackbone=Qwen3, Planning Framework=ReAct2026.01 | 31 | |
| ReCAPBackbone=DeepSeek, Planning Framework=ReCAP2026.01 | 27 | |
| ReCAPBackbone=Gemini, Planning Framework=ReCAP2026.01 | 21 | |
| ReActBackbone=DeepSeek, Planning Framework=ReAct2026.01 | 16 | |
| CoTBackbone=Gemini, Planning Framework=CoT2026.01 | 4 | |
| CoTBackbone=Qwen3, Planning Framework=CoT2026.01 | 0 | |
| CoTBackbone=DeepSeek, Planning Framework=CoT2026.01 | 0 |