Long-term Memory Retrieval on LongMemEval-S
100SSUEverMemOS
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| EverMemOS2026.02 | 100 | 78.5 | 96.7 | 71.2 | 87.2 | 78.6 | 82 | |
| SmartSearchindexing variant=index-free, Tokens=3,392, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 100 | 84.2 | 96.7 | 82.7 | 93.6 | 85.7 | 88.4 | |
| EmergenceMem2026.02 | 98.6 | 81.2 | 60 | 85.7 | 83.3 | 100 | 86 | |
| Mnemis2026.02 | 98.6 | 86.5 | 100 | 86.5 | 93.6 | 100 | 91.6 | |
| MemoraTokens=~2,900, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 98.6 | 78.2 | 83.3 | 89.5 | 97.4 | 78.6 | 87.4 | |
| EverMemOSTokens=2,800, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 97.1 | 73.7 | 93.3 | 77.4 | 89.7 | 85.7 | 83 | |
| SmartSearchindexing variant=indexed, Tokens=3,393, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 95.7 | 79.7 | 96.7 | 86.5 | 92.3 | 87.5 | 87.6 | |
| MemOSTokens=1,400, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 95.7 | 70.7 | 96.7 | 77.4 | 74.3 | 67.9 | 77.8 | |
| EMem-G2026.02 | 94.8 | 82.6 | 50 | 83.7 | 94.4 | 87.5 | 84.9 | |
| Mem02026.02 | 94.3 | 66.9 | 86.7 | 75.9 | 87.2 | 96.4 | 80.8 | |
| PREMem2026.02 | 92.9 | 57.1 | 36.7 | 59.4 | 84.6 | 12.5 | 60.8 | |
| ZepTokens=1,600, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 92.9 | 47.4 | 53.3 | 54.1 | 74.4 | 75 | 63.8 | |
| Nemori2026.02 | 90 | 55.6 | 86.7 | 72.2 | 79.5 | 92.9 | 74.6 | |
| NemoriTokens=~4,300, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 90 | 55.6 | 86.7 | 72.2 | 79.5 | 92.9 | 74.6 | |
| Full Context2026.02 | 85.7 | 51.1 | 16.7 | 60.2 | 76.9 | 98.2 | 65.6 | |
| Full-contextTokens=~115k, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 85.7 | 51.1 | 16.7 | 60.2 | 76.9 | 98.2 | 65.6 | |
| RAG2026.02 | 82.9 | 54.9 | 86.7 | 67.7 | 80.8 | 94.6 | 72.6 | |
| Mem0Tokens=1,100, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 82.9 | 63.2 | 90 | 72.2 | 66.7 | 26.8 | 66.4 | |
| MemUTokens=500, Answer LLM=gpt-4.1-mini, Judge LLM=gpt-4o-mini2026.03 | 67.1 | 42.1 | 76.7 | 17.3 | 41 | 19.6 | 38.4 |