Question Answering on LoCoMo (SH, MH, T, OD)

47.31MultiHop F1RaMem

Evaluation results

Method
RaMem2026.06	47.31	—	—	—	—	39.08	60.09	45.35	25.58	20.47	52.87	47.08	51.66	43.6
RaMem2026.06	43.73	—	—	—	—	35.99	61.57	47.02	26.35	21.73	58.14	51.48	54.23	45.86
SimpleMem2026.06	43.46	—	—	—	—	38.82	58.62	50.1	19.76	18.04	51.12	43.53	43.24	37.62
RaMem2026.06	36.1	—	—	—	—	28.07	44.17	32.72	17.71	13.79	50.59	44.88	44.55	37.33
SimpleMem2026.06	35.89	—	—	—	—	32.83	56.71	20.57	18.23	16.34	45.41	39.25	39.06	27.25
Mem02026.06	35.13	—	—	—	—	27.56	52.38	44.15	17.73	15.92	39.12	35.43	36.09	30.77
A-Mem2026.06	32.86	—	—	—	—	23.76	39.41	31.23	17.1	15.84	44.43	38.97	33.45	27.45
MemGPT2026.06	30.36	—	—	—	—	22.83	17.29	13.18	12.24	11.87	40.16	36.35	25.01	21.06
Mem02026.06	30.14	—	—	—	—	27.62	48.91	44.82	16.43	14.94	41.3	36.17	34.2	30.89
SimpleMem2026.06	28.97	—	—	—	—	24.93	42.85	36.49	15.35	13.9	46.62	40.69	33.45	29
LightMem2026.06	28.15	—	—	—	—	21.83	36.53	29.12	13.38	11.54	33.76	28.02	27.96	22.63
LoCoMo2026.06	28	—	—	—	—	18.47	9.09	5.78	16.47	14.8	61.56	54.19	28.78	23.31
A-Mem2026.06	25.06	—	—	—	—	17.32	51.01	44.75	13.22	14.75	41.02	36.99	32.58	28.45
LoCoMo2026.06	25.02	—	—	—	—	21.62	12.04	10.63	19.05	17.07	18.68	15.87	18.7	16.3
LightMem2026.06	24.96	—	—	—	—	21.66	20.55	18.39	19.21	17.68	33.79	29.66	24.63	21.85
Mem02026.06	22.42	—	—	—	—	16.83	32.48	26.13	15.23	12.54	33.05	27.24	25.8	20.69
RaMem2026.06	21.74	—	—	—	—	15.17	24.45	17	13.68	11.41	26.95	22.72	24.65	19.44
A-Mem2026.06	20.5	—	—	—	—	13.8	22.5	18.2	13.2	10.5	26.8	21.5	20.75	16
LightMem2026.06	18.53	—	—	—	—	14.23	26.78	21.52	14.12	11.24	29.48	23.83	22.23	17.71
MemGPT2026.06	17.72	—	—	—	—	16.02	19.44	16.54	11.29	10.18	25.59	24.25	18.51	16.75
SimpleMem2026.06	17.03	—	—	—	—	11.87	21.47	19.5	12.52	10.19	20.9	18.01	17.98	14.89
Mem02026.06	16.89	—	—	—	—	11.54	8.52	6.23	10.24	8.82	16.47	12.43	13.03	9.76
LightMem2026.06	16.43	—	—	—	—	11.39	6.92	4.56	8.06	7.23	18.28	15.24	12.42	9.61
ReadAgent2026.06	14.61	—	—	—	—	9.95	4.16	3.19	8.84	8.37	12.46	10.29	10.02	7.95
MemGPT2026.06	14.2	—	—	—	—	9.8	5.5	4.2	12.5	10.8	11.5	9.1	10.93	8.48
LoCoMo2026.06	13.5	—	—	—	—	9.2	6.8	5.5	10.1	8.8	14.5	11.2	11.23	8.68
A-Mem2026.06	12.57	—	—	—	—	9.01	27.59	25.07	7.12	7.28	17.23	13.12	16.13	13.62
MemoryBank2026.06	9.5	—	—	—	—	7.1	3.8	2.5	7.5	6.5	9.2	7.5	7.5	5.9
ReadAgent2026.06	7.2	—	—	—	—	5.1	3.5	3.1	5.5	5.4	8.1	6.2	6.08	4.95
MemoryBank2026.06	6.49	—	—	—	—	4.69	2.47	2.43	6.43	5.3	8.28	7.1	5.92	4.88
ReadAgent2026.06	6.48	—	—	—	—	5.6	5.31	4.23	7.66	6.62	9.18	7.91	7.16	6.09
MemGPT2026.06	5.07	—	—	—	—	4.31	2.94	2.95	7.04	7.1	7.26	5.52	5.58	4.97
MemoryBank2026.06	5	—	—	—	—	4.68	5.94	4.78	5.16	4.52	5.72	4.86	5.46	4.71
LoCoMo2026.06	4.61	—	—	—	—	4.29	3.11	2.71	4.55	5.97	7.03	5.69	4.83	4.67
MemoryBank2026.06	3.6	—	—	—	—	3.39	1.72	1.97	6.63	6.58	4.11	3.32	4.02	3.82
ReadAgent2026.06	2.47	—	—	—	—	1.78	3.01	3.01	5.57	5.22	3.25	2.51	3.58	3.13
A-MEM (baseline)2026.06	—	44.65	27.02	45.85	12.14	—	—	—	—	—	—	—	—	—
BeliefMem2026.06	—	48.41	40.51	51.88	28.73	—	—	—	—	—	—	—	—	—
Nous2026.06	—	63.5	55.32	58.57	62.5	—	—	—	—	—	—	—	—	—