Long-term conversational question answering on LongMemEval benchmark leaderboard · SOTA2 Research

Long-term conversational question answering on LongMemEval

97.14SS User AccuracyLightMem

Evaluation Results

Method	Links
LightMem2026.05		97.14	13.71	26.79	6	93.33	11.05	76.69	6.49	83.33	5.79	79.7	8.65	76.8	8.18
MemShot2026.05		95.71	82.48	98.21	78.05	33.33	6.94	57.89	42.73	71.79	61.3	48.87	34.88	66	50.91
MemShot2026.05		95.71	81.76	98.21	82.51	50	8.47	66.17	51.47	89.74	61.49	59.4	41.53	74.8	55.53
Text RAG2026.05		94.29	76.08	98.21	83.62	50	10.41	64.66	48.6	73.08	51.07	62.41	38.93	72.4	51.89
EverMemOS2026.05		94.29	26.06	89.29	25.95	90	13.55	64.66	10.64	83.33	14.61	57.89	15.98	74.2	16.73
LightMem2026.05		92.86	12.72	25	5.06	80	9.2	68.42	6.63	70.51	5.66	67.67	8.13	67.8	7.71
EverMemOS2026.05		92.86	30.39	67.86	27.83	56.67	10.81	60.9	11.44	74.36	17.47	49.62	15.6	65	17.94
MemoryOS2026.05		91.43	76.27	92.86	77.75	63.33	9.75	54.14	45.54	70.51	60.37	45.11	42.33	64.4	52.76
MemOCR2026.05		88.57	67.77	89.29	63.05	33.33	8.64	42.11	31.22	79.49	49.25	29.32	27.87	55.8	40.6
Text RAG2026.05		87.14	72.59	94.64	79.66	30	6.51	48.87	37.13	67.95	50.35	46.62	34.29	60.6	46.33
MemOS2026.05		85.71	22.8	94.64	25.48	56.67	11.37	47.37	6.67	80.77	7.95	51.13	7.52	64.8	11.74
MemoryOS2026.05		85.71	75.94	85.71	69.51	53.33	9.85	29.32	30.72	56.41	54.08	30.08	32.91	49.4	44.37
MemOS2026.05		85.71	10.24	94.64	16.69	73.33	12.86	48.12	4.76	84.62	6.73	58.65	6.27	68.6	8.06
MemOCR2026.05		85.71	70.53	98.21	69.2	50	11.98	52.63	40.89	76.92	53.69	36.84	27.9	61.8	45.32