Embodied AI on EmbodiedBench EB-Habitat

98.5Base ScoreA-Mem

Evaluation results

Method
A-Mem2026.05	98.5	75.5	73.17	40.6	82.11	83.17	75.5
A-Mem2026.05	98	72	52	24	80	78	67.33
G-Mem2026.05	93.75	73	62.36	48.32	80.19	80.65	73.04
MemCompiler2026.05	93.25	60.5	55.5	54.33	65.31	66.33	65.7
G-Mem2026.05	92	68	50	46	78	74	68
G-Mem2026.05	91.33	35.5	47.5	47.85	57.5	57.92	56.27
Mem02026.05	91.17	31.5	34.5	38.28	56.67	48.08	50.03
Langmem2026.05	90.85	34.5	36.5	38.95	55.17	47.41	50.56
MemCompiler2026.05	90	58	44	38	40	64	55.67
A-Mem2026.05	89.83	20.5	52.5	41.69	57.33	29.67	48.59
Mem02026.05	89.25	75	61	55.42	61.58	79.08	70.22
LangMem2026.05	89	74	66	32.53	83	84.23	71.49
No Mem2026.05	88.5	61	61	44.86	59.92	69.92	64.2
G-Mem2026.05	88	24	36	34	32	50	44
MemCompiler2026.05	86.75	62.5	59	46.93	61.57	65.41	63.69
No Mem2026.05	86	52	46	30	30	62	51
Mem02026.05	86	64	48	44	30	70	57
LangMem2026.05	86	68	56	14	74	78	62.67
A-Mem2026.05	86	12	38	24	36	24	36.67
Langmem2026.05	86	26	28	18	32	40	38.33
LangMem2026.05	86	49	48.51	22.03	61.67	63.17	55.06
G-Mem2026.05	84.5	46	43	34.95	59.08	63.67	55.2
LangMem2026.05	84	40	40	6	34	56	43.33
MemCompiler2026.05	84	54	56	38	36	60	54.67
Mem02026.05	84	24	26	20	34	42	38.33
Langmem2026.05	83.25	39	52	32.14	55.5	46	51.31
No Mem2026.05	82.67	35.5	42	26.97	47.83	40.42	45.89
G-Mem2026.05	82	36	20	18	30	56	40.33
No Mem2026.05	81.75	44.5	52	32.2	59.83	46.83	52.85
Mem02026.05	81	45	48	26.95	62.25	58	53.53
No Mem2026.05	80.75	33	60	24.19	56.83	34.58	48.22
No Mem2026.05	80	38	36	16	32	40	40.33
LoHo-Manip-4B2026.04	78	32	46	20	28	26	38
No Mem2026.05	78	22	52	10	30	26	36.33
No Mem2026.05	78	26	28	14	28	34	34.67
Mem02026.05	76	36	30	10	30	44	37.67
Langmem2026.05	76	28	44	16	28	40	38.67
Mem02026.05	74.33	42.5	58.86	33.36	57.5	45.25	51.97
GPT-4o mini2026.04	74	22	32	14	32	22	33
Llama3.2-11B2026.04	70	16	28	6	20	10	25
A-Mem2026.05	70	33	35	18.12	55.83	56.67	44.77
Qwen3-VL-4B2026.04	68	16	38	10	26	20	30
Mem02026.05	68	34	44	16	30	38	38.33
A-Mem2026.05	64	30	18	6	28	48	32.33
MemGen2026.05	60.23	19.67	30.33	15.7	26.21	40.47	32.1
InternVL3-8B2026.04	60	14	24	10	20	18	24
MemGen2026.05	57.91	15	25	10.17	56.17	24.33	31.43
MemGen2026.05	54	8	18	4	24	18	21
G-Mem2026.05	50.33	19	21.5	4.67	40.17	16.17	25.31
MemGen2026.05	50	14	22	10	22	36	25.67
G-Mem2026.05	38	12	8	2	20	8	14.67
A-Mem2026.05	37.25	15.5	10	5.33	21.75	15.5	17.56
A-Mem2026.05	24	8	6	0	4	8	8.33