Embodied Task Success on EmbodiedBench EB-Habitat 1.0 (test)
52.33Average Task SuccessEmbodiSkill
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| EmbodiSkillExecutor=Qwen3-VL-32B-Instruct, Skill Evolution Model=Gemini-3-flash2026.05 | 52.33 | 96 | 44 | 52 | 62 | 36 | 24 | |
| EmbodiSkillExecutor=Qwen3-VL-32B-Instruct, Skill Evolution Model=GPT-5.22026.05 | 50.33 | 92 | 46 | 50 | 54 | 34 | 26 | |
| Gemini-3-flashExecutor=Direct (Closed-source)2026.05 | 46 | 78 | 42 | 38 | 56 | 32 | 30 | |
| EmbodiSkillExecutor=Qwen3-VL-8B-Instruct, Skill Evolution Model=GPT-5.22026.05 | 45.33 | 76 | 46 | 36 | 52 | 38 | 24 | |
| G-MemoryExecutor=Qwen3-VL-32B-Instruct, Memory Strategy=G-Memory2026.05 | 45 | 92 | 24 | 36 | 50 | 32 | 34 | |
| EmbodiSkillExecutor=Qwen3-VL-8B-Instruct, Skill Evolution Model=Gemini-3-flash2026.05 | 41 | 78 | 34 | 32 | 52 | 34 | 16 | |
| GPT-5.2Executor=Direct (Closed-source)2026.05 | 40 | 80 | 40 | 26 | 44 | 32 | 18 | |
| Mem0Executor=Qwen3-VL-32B-Instruct, Memory Strategy=Mem02026.05 | 38.33 | 84 | 24 | 26 | 42 | 34 | 20 | |
| LangMemExecutor=Qwen3-VL-32B-Instruct, Memory Strategy=LangMem2026.05 | 38.33 | 86 | 26 | 28 | 40 | 32 | 18 | |
| No memoryExecutor=Qwen3-VL-32B-Instruct, Memory Strategy=None2026.05 | 34.67 | 78 | 26 | 28 | 34 | 28 | 14 | |
| G-MemoryExecutor=Qwen3-VL-8B-Instruct, Memory Strategy=G-Memory2026.05 | 25.66 | 58 | 14 | 12 | 34 | 30 | 6 | |
| No memoryExecutor=Qwen3-VL-8B-Instruct, Memory Strategy=None2026.05 | 24 | 58 | 20 | 20 | 18 | 18 | 10 | |
| Mem0Executor=Qwen3-VL-8B-Instruct, Memory Strategy=Mem02026.05 | 20.33 | 60 | 16 | 8 | 16 | 14 | 8 | |
| LangMemExecutor=Qwen3-VL-8B-Instruct, Memory Strategy=LangMem2026.05 | 19.67 | 60 | 12 | 8 | 16 | 14 | 8 |