Retrieval on LongMemEval
99Recall@5Supermemory ASMR
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Supermemory ASMRArchitecture=Multi-agent agentic, Write=LLM, Price=Paid2026.04 | 99 | — | |
| MemPalace (raw)Architecture=ChromaDB + verbatim, Write=None, Price=Free2026.04 | 96.6 | — | |
| MastraArchitecture=GPT-5-mini observ., Write=LLM, Price=Paid2026.04 | 94.9 | — | |
| Mem0 (token-eff.)Architecture=Hierarchical extract, Write=LLM, Price=$19–2492026.04 | 93.4 | — | |
| HindsightArchitecture=Retain/Recall/Reflect, Write=LLM, Price=Paid2026.04 | 91.4 | — | |
| QRhead+ReAttnBase LLM=Llama-3.1-8B-Instruct2026.02 | 85.8 | 92.4 | |
| QRheadBase LLM=Llama-3.1-8B-Instruct2026.02 | 85.5 | 91.7 | |
| Zep/GraphitiArchitecture=Temporal KG (Neo4j), Write=LLM, Price=$25+2026.04 | 85 | — | |
| QRhead+ReAttnBase LLM=Llama-3.2-3B-Instruct2026.02 | 77.9 | 87.3 | |
| QRheadBase LLM=Llama-3.2-3B-Instruct2026.02 | 77.6 | 86.6 | |
| ICR+ReAttnBase LLM=Llama-3.1-8B-Instruct2026.02 | 77.1 | 85 | |
| ICRBase LLM=Llama-3.1-8B-Instruct2026.02 | 77 | 84.4 | |
| ICR+ReAttnBase LLM=Llama-3.2-3B-Instruct2026.02 | 68.8 | 79.2 | |
| ICRBase LLM=Llama-3.2-3B-Instruct2026.02 | 68.7 | 78.8 | |
| StellaBase LLM=Llama-3.2-3B-Instruct2026.02 | 63.9 | 77.6 | |
| StellaBase LLM=Llama-3.1-8B-Instruct2026.02 | 63.9 | 77.6 | |
| ContrieverBase LLM=Llama-3.2-3B-Instruct2026.02 | 62.7 | 79.2 | |
| ContrieverBase LLM=Llama-3.1-8B-Instruct2026.02 | 62.7 | 79.2 | |
| BM25Base LLM=Llama-3.2-3B-Instruct2026.02 | 57.5 | 67.5 | |
| BM25Base LLM=Llama-3.1-8B-Instruct2026.02 | 57.5 | 67.5 | |
| Mem0 (pre-2026)Architecture=LLM fact extraction, Write=LLM, Price=$19–2492026.04 | 49 | — | |
| RankGPTBubbleBase LLM=Llama-3.1-8B-Instruct2026.02 | 8.3 | 9 | |
| RankGPTBubbleBase LLM=Llama-3.2-3B-Instruct2026.02 | 2.1 | 3.8 | |
| RankGPTw/oBase LLM=Llama-3.1-8B-Instruct2026.02 | 2.1 | 4 | |
| RankGPTw/oBase LLM=Llama-3.2-3B-Instruct2026.02 | 1.8 | 3.4 |