Planning on AlfWorld, BabyAI, Maze, SciWorld, TextCraft, WebShop, Wordle (held-out)
17.5AlfWorld Success RateReAct
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ReActplanner=shared one-step lookahead planner2026.05 | 17.5 | 86.7 | 83.3 | 83.5 | 93.8 | 56 | 100 | 74.4 | |
| LLM-Directplanner=shared one-step lookahead planner, icl_prompt_context=k=3 transitions2026.05 | 14.5 | 88.9 | 100 | 85 | 95.8 | 46 | 100 | 75.8 | |
| Word2Worldplanner=shared one-step lookahead planner2026.05 | 9.6 | 75.6 | 83.3 | 66.7 | 86.5 | 22.6 | 100 | 63.5 | |
| PatchWorld-Simpleplanner=shared one-step lookahead planner, backbone=Qwen3-Coder-480B2026.05 | 6 | 87.8 | 100 | 86.5 | 95.8 | 58.5 | 100 | 76.4 | |
| PatchWorld-Residualplanner=shared one-step lookahead planner, backbone=Qwen3-Coder-480B2026.05 | 5.5 | 86.1 | 83.3 | 82.5 | 96.9 | 56 | 100 | 72.9 | |
| WorldCoderplanner=shared one-step lookahead planner2026.05 | 3.5 | 81.7 | 66.7 | 88.5 | 67.7 | 43 | 100 | 64.4 | |
| PoE-Worldplanner=shared one-step lookahead planner2026.05 | 3.5 | 84.4 | 83.3 | 93.5 | 70.8 | 49.5 | 100 | 69.3 |