Embodied Task Completion on ALFWorld v1.0 (test)
100Pick Success RateReAct
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ReActMethod Category=Agent- or memory-based, Retrieved external skills=false2026.05 | 100 | 33.3 | 25 | 53.8 | 23.8 | 26.7 | 50.5 | |
| ExpeLMethod Category=Agent- or memory-based, Retrieved external skills=false2026.05 | 97.1 | 62.5 | 38.5 | 13.3 | 21.7 | 61.9 | 53.5 | |
| Zero-ShotMethod Category=Prompt-based, Retrieved external skills=true2026.05 | 94.3 | 40 | 81.2 | 38.5 | 17.4 | 55 | 63.3 | |
| Few-ShotMethod Category=Prompt-based, Retrieved external skills=true2026.05 | 94.3 | 60 | 84.4 | 38.5 | 34.8 | 30 | 64.1 | |
| ReflexionMethod Category=Agent- or memory-based, Retrieved external skills=false2026.05 | 93.9 | 30 | 52 | 20 | 47.8 | 68.2 | 59.4 | |
| Mem0Method Category=Agent- or memory-based, Retrieved external skills=false2026.05 | 93.9 | 30 | 32 | 26.7 | 17.4 | 18.2 | 42.2 | |
| Skill0Method Category=RL-based, Retrieved external skills=false2026.05 | 93.6 | 87.5 | 59.8 | 66.7 | 57.6 | 78.4 | 74.2 | |
| SLIMMethod Category=RL-based, Retrieved external skills=true2026.05 | 92.9 | 100 | 91.4 | 78.3 | 88.5 | 81.2 | 87.5 | |
| SLIMMethod Category=RL-based, Retrieved external skills=false2026.05 | 91.4 | 80 | 46.9 | 61.5 | 73.9 | 85 | 72.7 | |
| SkillRLMethod Category=RL-based, Retrieved external skills=true2026.05 | 90.6 | 75 | 54.6 | 76.2 | 67.7 | 87.5 | 75 | |
| GRPOMethod Category=RL-based, Retrieved external skills=false2026.05 | 85.4 | 100 | 49.8 | 64.6 | 53.1 | 54.2 | 67.2 | |
| GRPOMethod Category=RL-based, Retrieved external skills=true2026.05 | 84.6 | 62.5 | 48.9 | 68.8 | 61 | 80.8 | 68.8 | |
| Zero-ShotMethod Category=Prompt-based, Retrieved external skills=false2026.05 | 82.9 | 0 | 31.2 | 23.1 | 21.7 | 30 | 41.4 | |
| Few-ShotMethod Category=Prompt-based, Retrieved external skills=false2026.05 | 80 | 40 | 37.5 | 7.7 | 17.4 | 15 | 39.1 | |
| EvolveRMethod Category=RL-based, Retrieved external skills=false2026.05 | 67.6 | 37.5 | 49.3 | 15.6 | 36 | 36.5 | 39.8 |