Embodied AI on EmbodiedBench EB-Habitat
98.5Base ScoreA-Mem
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| A-MemModel=Gemini-3-flash2026.05 | 98.5 | 75.5 | 73.17 | 40.6 | 82.11 | 83.17 | 75.5 | |
| A-MemExecutor=Gemini2026.05 | 98 | 72 | 52 | 24 | 80 | 78 | 67.33 | |
| G-MemModel=Gemini-3-flash2026.05 | 93.75 | 73 | 62.36 | 48.32 | 80.19 | 80.65 | 73.04 | |
| MemCompilerModel=Qwen-3-VL-32B2026.05 | 93.25 | 60.5 | 55.5 | 54.33 | 65.31 | 66.33 | 65.7 | |
| G-MemExecutor=Gemini2026.05 | 92 | 68 | 50 | 46 | 78 | 74 | 68 | |
| G-MemModel=Qwen-3-VL-32B2026.05 | 91.33 | 35.5 | 47.5 | 47.85 | 57.5 | 57.92 | 56.27 | |
| Mem0Model=Qwen-3-VL-32B2026.05 | 91.17 | 31.5 | 34.5 | 38.28 | 56.67 | 48.08 | 50.03 | |
| LangmemModel=Qwen-3-VL-32B2026.05 | 90.85 | 34.5 | 36.5 | 38.95 | 55.17 | 47.41 | 50.56 | |
| MemCompilerExecutor=Qwen-3-VL-32B2026.05 | 90 | 58 | 44 | 38 | 40 | 64 | 55.67 | |
| A-MemModel=Qwen-3-VL-32B2026.05 | 89.83 | 20.5 | 52.5 | 41.69 | 57.33 | 29.67 | 48.59 | |
| Mem0Model=Gemini-3-flash2026.05 | 89.25 | 75 | 61 | 55.42 | 61.58 | 79.08 | 70.22 | |
| LangMemModel=Gemini-3-flash2026.05 | 89 | 74 | 66 | 32.53 | 83 | 84.23 | 71.49 | |
| No MemModel=Gemini-3-flash2026.05 | 88.5 | 61 | 61 | 44.86 | 59.92 | 69.92 | 64.2 | |
| G-MemExecutor=Qwen-3-VL-32B2026.05 | 88 | 24 | 36 | 34 | 32 | 50 | 44 | |
| MemCompilerModel=Qwen-2.5-VL-32B2026.05 | 86.75 | 62.5 | 59 | 46.93 | 61.57 | 65.41 | 63.69 | |
| No MemExecutor=Gemini2026.05 | 86 | 52 | 46 | 30 | 30 | 62 | 51 | |
| Mem0Executor=Gemini2026.05 | 86 | 64 | 48 | 44 | 30 | 70 | 57 | |
| LangMemExecutor=Gemini2026.05 | 86 | 68 | 56 | 14 | 74 | 78 | 62.67 | |
| A-MemExecutor=Qwen-3-VL-32B2026.05 | 86 | 12 | 38 | 24 | 36 | 24 | 36.67 | |
| LangmemExecutor=Qwen-3-VL-32B2026.05 | 86 | 26 | 28 | 18 | 32 | 40 | 38.33 | |
| LangMemModel=GPT-5.22026.05 | 86 | 49 | 48.51 | 22.03 | 61.67 | 63.17 | 55.06 | |
| G-MemModel=GPT-5.22026.05 | 84.5 | 46 | 43 | 34.95 | 59.08 | 63.67 | 55.2 | |
| LangMemExecutor=GPT-52026.05 | 84 | 40 | 40 | 6 | 34 | 56 | 43.33 | |
| MemCompilerExecutor=Qwen-2.5-VL-32B2026.05 | 84 | 54 | 56 | 38 | 36 | 60 | 54.67 | |
| Mem0Executor=Qwen-3-VL-32B2026.05 | 84 | 24 | 26 | 20 | 34 | 42 | 38.33 | |
| LangmemModel=Qwen-2.5-VL-32B2026.05 | 83.25 | 39 | 52 | 32.14 | 55.5 | 46 | 51.31 | |
| No MemModel=Qwen-3-VL-32B2026.05 | 82.67 | 35.5 | 42 | 26.97 | 47.83 | 40.42 | 45.89 | |
| G-MemExecutor=GPT-52026.05 | 82 | 36 | 20 | 18 | 30 | 56 | 40.33 | |
| No MemModel=GPT-5.22026.05 | 81.75 | 44.5 | 52 | 32.2 | 59.83 | 46.83 | 52.85 | |
| Mem0Model=GPT-5.22026.05 | 81 | 45 | 48 | 26.95 | 62.25 | 58 | 53.53 | |
| No MemModel=Qwen-2.5-VL-32B2026.05 | 80.75 | 33 | 60 | 24.19 | 56.83 | 34.58 | 48.22 | |
| No MemExecutor=GPT-52026.05 | 80 | 38 | 36 | 16 | 32 | 40 | 40.33 | |
| LoHo-Manip-4BParameters=4B2026.04 | 78 | 32 | 46 | 20 | 28 | 26 | 38 | |
| No MemExecutor=Qwen-2.5-VL-32B2026.05 | 78 | 22 | 52 | 10 | 30 | 26 | 36.33 | |
| No MemExecutor=Qwen-3-VL-32B2026.05 | 78 | 26 | 28 | 14 | 28 | 34 | 34.67 | |
| Mem0Executor=GPT-52026.05 | 76 | 36 | 30 | 10 | 30 | 44 | 37.67 | |
| LangmemExecutor=Qwen-2.5-VL-32B2026.05 | 76 | 28 | 44 | 16 | 28 | 40 | 38.67 | |
| Mem0Model=Qwen-2.5-VL-32B2026.05 | 74.33 | 42.5 | 58.86 | 33.36 | 57.5 | 45.25 | 51.97 | |
| GPT-4o miniSize=mini2026.04 | 74 | 22 | 32 | 14 | 32 | 22 | 33 | |
| Llama3.2-11BParameters=11B2026.04 | 70 | 16 | 28 | 6 | 20 | 10 | 25 | |
| A-MemModel=GPT-5.22026.05 | 70 | 33 | 35 | 18.12 | 55.83 | 56.67 | 44.77 | |
| Qwen3-VL-4BParameters=4B2026.04 | 68 | 16 | 38 | 10 | 26 | 20 | 30 | |
| Mem0Executor=Qwen-2.5-VL-32B2026.05 | 68 | 34 | 44 | 16 | 30 | 38 | 38.33 | |
| A-MemExecutor=GPT-52026.05 | 64 | 30 | 18 | 6 | 28 | 48 | 32.33 | |
| MemGenModel=Qwen-3-VL-32B2026.05 | 60.23 | 19.67 | 30.33 | 15.7 | 26.21 | 40.47 | 32.1 | |
| InternVL3-8BParameters=8B2026.04 | 60 | 14 | 24 | 10 | 20 | 18 | 24 | |
| MemGenModel=Qwen-2.5-VL-32B2026.05 | 57.91 | 15 | 25 | 10.17 | 56.17 | 24.33 | 31.43 | |
| MemGenExecutor=Qwen-2.5-VL-32B2026.05 | 54 | 8 | 18 | 4 | 24 | 18 | 21 | |
| G-MemModel=Qwen-2.5-VL-32B2026.05 | 50.33 | 19 | 21.5 | 4.67 | 40.17 | 16.17 | 25.31 | |
| MemGenExecutor=Qwen-3-VL-32B2026.05 | 50 | 14 | 22 | 10 | 22 | 36 | 25.67 | |
| G-MemExecutor=Qwen-2.5-VL-32B2026.05 | 38 | 12 | 8 | 2 | 20 | 8 | 14.67 | |
| A-MemModel=Qwen-2.5-VL-32B2026.05 | 37.25 | 15.5 | 10 | 5.33 | 21.75 | 15.5 | 17.56 | |
| A-MemExecutor=Qwen-2.5-VL-32B2026.05 | 24 | 8 | 6 | 0 | 4 | 8 | 8.33 |