Embodied Household Task on ALFWorld (test)
100Pick Success RateSkillMaster
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SkillMasterCategory=Memory-Augmented RL-based Methods2026.05 | 100 | 100 | 100 | 97.1 | 95.7 | 100 | 98.7 | |
| SkillRLCategory=Memory-Augmented RL-based Methods2026.05 | 97.9 | 71.4 | 90 | 90 | 95.5 | 87.5 | 89.9 | |
| Gemini-2.5-ProCategory=Closed-source LLMs2026.05 | 92.8 | 63.3 | 62.1 | 69 | 26.6 | 58.7 | 60.3 | |
| GRPOCategory=RL-based Methods2026.05 | 90.8 | 66.1 | 89.3 | 74.7 | 72.5 | 64.7 | 77.6 | |
| SimpleMem+GRPOCategory=Memory-Augmented RL-based Methods2026.05 | 89.5 | 36.3 | 60 | 50 | 64.9 | 26.3 | 62.5 | |
| RLOOCategory=RL-based Methods2026.05 | 87.6 | 78.2 | 87.3 | 81.3 | 71.9 | 48.9 | 75.5 | |
| Mem0+GRPOCategory=Memory-Augmented RL-based Methods2026.05 | 78.1 | 54.8 | 56.1 | 31 | 65 | 26.9 | 54.7 | |
| GPT-4oCategory=Closed-source LLMs2026.05 | 75.3 | 60.8 | 31.2 | 56.7 | 21.6 | 49.8 | 48 | |
| EvolveRCategory=Memory-Augmented RL-based Methods2026.05 | 64.9 | 33.3 | 46.4 | 13.3 | 33.3 | 33.3 | 43.8 | |
| SimpleMemCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 64.5 | 33.3 | 20 | 12.5 | 33.3 | 3.84 | 29.7 | |
| MemRLCategory=Memory-Augmented RL-based Methods2026.05 | 62.8 | 38.5 | 22.2 | 12.5 | 8 | 0 | 21.4 | |
| ReflexionCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 62 | 41.6 | 44.9 | 30.9 | 36.3 | 23.8 | 42.7 | |
| MemPCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 54.3 | 38.5 | 48.1 | 56.2 | 32 | 16.7 | 41.4 | |
| Mem0Category=Prompt-based Agentic or Memory-based Methods2026.05 | 54 | 55 | 26.9 | 36.4 | 20.8 | 7.69 | 33.6 | |
| ReActCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 48.5 | 35.4 | 34.3 | 13.2 | 18.2 | 17.6 | 31.2 | |
| Qwen2.5-7B-InstructCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 33.4 | 21.6 | 19.3 | 6.9 | 2.8 | 3.2 | 14.8 | |
| ExpeLCategory=Prompt-based Agentic or Memory-based Methods2026.05 | 21 | 67 | 55 | 52 | 71 | 6 | 46.3 |