Long-context Memory Evaluation on LongMemEval
95.6Average ScoreChronos High
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Chronos HighLLM Backbone=Advanced2026.03 | 95.6 | 100 | 100 | 95.5 | 88.72 | 100 | 98.57 | — | — | — | — | — | — | — | |
| Mastra2026.03 | 92.8 | 90 | 96.4 | 94 | 87.2 | 94.9 | 97.1 | — | — | — | — | — | — | — | |
| Honcho2026.03 | 92.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CognisJudge model=GPT-4.1, Answer model=Best result across 8 models2026.03 | 92.4 | 93.3 | 92.9 | 92.5 | 87.2 | 96.2 | 100 | — | — | — | — | — | — | — | |
| HindsightJudge Model=OSS-120B2026.03 | 91.4 | 80 | 96.4 | 91 | 87.2 | 94.9 | 97.1 | — | — | — | — | — | — | — | |
| HindsightArchitecture=Hybrid (Reflection and Vector), Retrieval=Parallel, Query Strategy=Multi-Query2026.04 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MemantoArchitecture=Vector Only, Retrieval=RAG, Query Strategy=Single Query2026.04 | 89.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeMembackbone model=GPT-4.1-mini2026.05 | 89.6 | 91.7 | 93.6 | 87.5 | 88.5 | 88.5 | 93 | — | — | — | — | — | — | — | |
| MEMORA (P)Retriever=Policy, Context length=2.9k2026.02 | 87.4 | 83.3 | 78.6 | 89.5 | 78.2 | 97.4 | 98.6 | — | — | — | — | — | — | — | |
| Mnemisbackbone model=GPT-4.1-mini2026.05 | 87.2 | 89.4 | 91.9 | 84.3 | 84.6 | 87.9 | 92.3 | — | — | — | — | — | — | — | |
| EmergenceMemArchitecture=Hybrid (Graph and Vector), Retrieval=Parallel, Query Strategy=Multi-Query2026.04 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DeMembackbone model=GPT-4o-mini2026.05 | 85.3 | 86.7 | 92.9 | 83.7 | 81.2 | 84.6 | 90.1 | — | — | — | — | — | — | — | |
| Supermemory2026.03 | 85.2 | 70 | 98.2 | 82 | 76.7 | 89.7 | 98.6 | — | — | — | — | — | — | — | |
| SupermemoryArchitecture=Hybrid (Graph and Vector), Retrieval=Parallel, Query Strategy=Multi-Query2026.04 | 85.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MEMORA (S)Retriever=Semantic, Context length=2.1k2026.02 | 83.8 | 76.7 | 76.8 | 84.2 | 73.7 | 96.2 | 97.1 | — | — | — | — | — | — | — | |
| Mnemisbackbone model=GPT-4o-mini2026.05 | 83.5 | 83.3 | 94.9 | 80.9 | 74.6 | 87.4 | 91.7 | — | — | — | — | — | — | — | |
| EverMemOS2026.04 | 83 | 93.33 | 85.71 | 77.44 | 73.68 | 89.74 | 97.14 | — | — | — | 2,800 | — | — | — | |
| MemReader-4B-GRPOModel size=4B, Training=GRPO2026.04 | 83 | 90 | 73.21 | 84.21 | 73.68 | 91.03 | 94.29 | — | — | — | 922 | — | — | — | |
| EMem-Gbackbone model=GPT-4.1-mini2026.05 | 83 | 48.1 | 85.4 | 82 | 80.3 | 91.8 | 93.3 | — | — | — | — | — | — | — | |
| SuperMemoryJudge model=GPT-4.12026.03 | 81.6 | 70 | 96.4 | 76.7 | 71.4 | 88.5 | 97.1 | — | — | — | — | — | — | — | |
| MemProBackbone=Qwen3-30B-A3B-Instruct-2507, Evolution Iterations=152026.05 | 80.8 | 80 | 98.21 | 71.43 | 75.94 | 82.05 | 92.86 | — | — | — | — | — | — | — | |
| MemReader-0.6BModel size=0.6B2026.04 | 80.2 | 90 | 75 | 75.9 | 75.18 | 82.05 | 95.71 | — | — | — | 1,166 | — | — | — | |
| MemReader-4B-SFTModel size=4B, Training=SFT2026.04 | 80 | 90 | 69.64 | 78.19 | 71.42 | 85.8 | 97.1 | — | — | — | 963 | — | — | — | |
| MemProBackbone=GPT-4o-mini, Evolution Iterations=152026.05 | 79 | 86.67 | 60.71 | 77.44 | 73.68 | 83.33 | 98.57 | — | — | — | — | — | — | — | |
| MemProBackbone=Qwen3-30B-A3B-Instruct-2507, Evolution Iterations=102026.05 | 78.8 | 78.39 | 94.12 | 68.21 | 75.03 | 80.84 | 91.76 | — | — | — | — | — | — | — | |
| Mem0backbone model=GPT-4.1-mini2026.05 | 78.7 | 83.6 | 94.5 | 74.3 | 64.6 | 84.5 | 92.5 | — | — | — | — | — | — | — | |
| MemOS-1031Tokens=1.4k2026.01 | 77.8 | 96.7 | 67.9 | 77.4 | 70.7 | 74.3 | 95.7 | — | — | — | — | — | — | — | |
| MemOS2026.04 | 77.8 | 96.67 | 67.86 | 77.44 | 70.67 | 74.26 | 95.71 | — | — | — | 1,400 | — | — | — | |
| MemProBackbone=GPT-4o-mini, Evolution Iterations=102026.05 | 77.11 | 83.72 | 58.24 | 75.68 | 71.96 | 82.08 | 96.31 | — | — | — | — | — | — | — | |
| MemProBackbone=Qwen3-30B-A3B-Instruct-2507, Evolution Iterations=52026.05 | 76.96 | 77.46 | 82.59 | 68.73 | 73.82 | 79.64 | 90.87 | — | — | — | — | — | — | — | |
| GEPABackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 76.2 | 76.67 | 80.36 | 68.42 | 71.43 | 82.05 | 90 | — | — | — | — | — | — | — | |
| EMem-Gbackbone model=GPT-4o-mini2026.05 | 76.1 | 30.7 | 84.6 | 72.6 | 71.8 | 93.1 | 84.6 | — | — | — | — | — | — | — | |
| MemProBackbone=GPT-4o-mini, Evolution Iterations=52026.05 | 75.77 | 82.11 | 54.68 | 73.86 | 72.41 | 80.93 | 94.22 | — | — | — | — | — | — | — | |
| GEPABackbone=GPT-4o-mini2026.05 | 75.6 | 76.67 | 78.57 | 69.17 | 71.43 | 79.49 | 88.57 | — | — | — | — | — | — | — | |
| NemoriContext length=3.7-4.8k2026.02 | 74.6 | 86.7 | 92.9 | 72.2 | 55.6 | 79.5 | 90 | — | — | — | — | — | — | — | |
| MetaMemBackbone=GPT-4o-mini2026.05 | 74.47 | 91.7 | 63.5 | 68.8 | 71.1 | 78.2 | 88.9 | — | — | — | — | — | — | — | |
| GAMBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 72.8 | 63.33 | 66.07 | 67.67 | 67.29 | 82.05 | 92.14 | — | — | — | — | — | — | — | |
| MemobaseTokens=1.5k2026.01 | 72.4 | 80.1 | 23.2 | 75.9 | 66.9 | 89.7 | 92.9 | — | — | — | — | — | — | — | |
| Memobase2026.04 | 72.4 | 80 | 23.21 | 75.93 | 66.91 | 89.74 | 92.85 | — | — | — | 1,541 | — | — | — | |
| GAMBackbone=GPT-4o-mini2026.05 | 72.4 | 70 | 94.64 | 60.15 | 70.68 | 78.21 | 75.71 | — | — | — | — | — | — | — | |
| Nemoribackbone model=GPT-4.1-mini2026.05 | 72.3 | 84.3 | 91.5 | 69.4 | 53.7 | 77.4 | 87.3 | — | — | — | — | — | — | — | |
| MetaMemBackbone=Qwen3-30B-A3B-Instruct2026.01 | 71.9 | 94.16 | 38.14 | 69.6 | 69.24 | 79.18 | 90.7 | — | — | — | — | — | — | — | |
| MetaMemBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 71.9 | 94.16 | 38.14 | 69.6 | 69.24 | 79.18 | 90.7 | — | — | — | — | — | — | — | |
| SimpleMemBackbone=GPT-4o-mini2026.05 | 71.6 | 73.33 | 75 | 69.17 | 60.9 | 78.21 | 85.71 | — | — | — | — | — | — | — | |
| Zep/GraphitiJudge model=GPT-4.12026.03 | 71.2 | 56.7 | 80.4 | 62.4 | 57.9 | 83.3 | 92.9 | — | — | — | — | — | — | — | |
| ZepArchitecture=Hybrid (Graph and Vector), Retrieval=Parallel, Query Strategy=Single Query2026.04 | 71.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RAGbackbone model=GPT-4.1-mini2026.05 | 70.1 | 84.8 | 92.3 | 64.6 | 52.2 | 79.2 | 80.7 | — | — | — | — | — | — | — | |
| LightMemBackbone=GPT-4o-mini2026.05 | 69.81 | 68.18 | 32.14 | 67.18 | 71.74 | 83.12 | 87.14 | — | — | — | — | — | — | — | |
| Mem0backbone model=GPT-4o-mini2026.05 | 69.4 | 32.3 | 95.1 | 61.6 | 63.3 | 71.3 | 89.3 | — | — | — | — | — | — | — | |
| SimpleMemBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 69.2 | 76.67 | 69.64 | 65.41 | 59.4 | 75.64 | 84.29 | — | — | — | — | — | — | — | |
| MetaMemBackbone=Llama3.1-70B-Instruct2026.01 | 69.08 | 66.12 | 25.64 | 66.28 | 75.5 | 77.76 | 90.28 | — | — | — | — | — | — | — | |
| BMAM2026.01 | 67.6 | 100 | 76.8 | 59.4 | 52.6 | 70.5 | 87.1 | — | — | — | — | — | — | — | |
| LightMemBackbone=Qwen3-30B-A3B-Instruct2026.01 | 67.5 | 91.67 | 32.56 | 64.22 | 62.86 | 75.76 | 90.57 | — | — | — | — | — | — | — | |
| Mem0Tokens=1.1k2026.01 | 66.4 | 90 | 26.8 | 72.2 | 63.2 | 66.7 | 82.9 | — | — | — | — | — | — | — | |
| Mem02026.04 | 66.4 | 90 | 26.78 | 72.18 | 63.15 | 66.67 | 82.86 | — | — | — | 1,066 | — | — | — | |
| LightMemBackbone=Llama3.1-70B-Instruct2026.01 | 66.17 | 70.24 | 22.36 | 52.52 | 75.31 | 76.92 | 90.36 | — | — | — | — | — | — | — | |
| Full ContextContext length=115k2026.02 | 65.6 | 16.7 | 98.2 | 60.2 | 51.1 | 76.9 | 85.7 | — | — | — | — | — | — | — | |
| A-MEMBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 65.2 | 40 | 96.43 | 51.88 | 51.12 | 76.93 | 90 | — | — | — | — | — | — | — | |
| RAGbackbone model=GPT-4o-mini2026.05 | 65 | 66.7 | 89.6 | 61.3 | 45 | 67.7 | 86.9 | — | — | — | — | — | — | — | |
| ZepTokens=1.6k2026.01 | 63.8 | 53.3 | 75 | 54.1 | 47.4 | 74.4 | 92.9 | — | — | — | — | — | — | — | |
| Zep2026.04 | 63.8 | 53.3 | 75 | 54.1 | 47.4 | 74.4 | 92.9 | — | — | — | 1,600 | — | — | — | |
| Full Contextbackbone model=GPT-4.1-mini2026.05 | 62.9 | 15.4 | 91.5 | 57.8 | 49.2 | 74.7 | 83.1 | — | — | — | — | — | — | — | |
| A-MemBackbone=Qwen3-30B-A3B-Instruct2026.01 | 62.88 | 41.67 | 86.05 | 51.38 | 52.38 | 72.73 | 85.85 | — | — | — | — | — | — | — | |
| A-MemBackbone=Llama3.1-70B-Instruct2026.01 | 62.88 | 32.5 | 88.64 | 57.45 | 56.72 | 73.56 | 84.29 | — | — | — | — | — | — | — | |
| MemoryOSBackbone=Llama3.1-70B-Instruct2026.01 | 62.75 | 50 | 83.72 | 55.05 | 51.43 | 62.12 | 90.57 | — | — | — | — | — | — | — | |
| RAGBackbone=Qwen3-30B-A3B-Instruct2026.01 | 62.25 | 75 | 88.37 | 49.54 | 46.67 | 66.67 | 86.79 | — | — | — | — | — | — | — | |
| A-MEMBackbone=GPT-4o-mini2026.05 | 62.2 | 46.67 | 96.43 | 47.36 | 48.87 | 64.11 | 92.86 | — | — | — | — | — | — | — | |
| Nemoribackbone model=GPT-4o-mini2026.05 | 61.8 | 44.5 | 81.5 | 58.6 | 48.5 | 59.8 | 86.7 | — | — | — | — | — | — | — | |
| RAGBackbone=GPT-4o-mini2026.05 | 60.9 | 53.33 | 98.21 | 39.85 | 48.48 | 67.95 | 90 | — | — | — | — | — | — | — | |
| RAGBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 60.69 | 70 | 98.21 | 36.84 | 47.73 | 65.38 | 91.43 | — | — | — | — | — | — | — | |
| RAGBackbone=Llama3.1-70B-Instruct2026.01 | 60.5 | 58.33 | 90.7 | 47.71 | 48.57 | 62.12 | 84.91 | — | — | — | — | — | — | — | |
| Full ContextArchitecture=Full Context, Retrieval=Full, Query Strategy=Not applicable2026.04 | 60.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SupermemoryTokens=0.4k2026.01 | 58.4 | 89.9 | 58.9 | 44.4 | 52.6 | 55.1 | 85.7 | — | — | — | — | — | — | — | |
| LightMemBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 58.13 | 80 | 31.25 | 54.2 | 51.91 | 66.67 | 80 | — | — | — | — | — | — | — | |
| Full TextBackbone=GPT-4o-mini2026.05 | 56.89 | 36.67 | 89.29 | 31.58 | 45.45 | 76.92 | 87.14 | — | — | — | — | — | — | — | |
| MapReduceBackbone=Qwen3-30B-A3B-Instruct2026.01 | 55.3 | 62.5 | 81.4 | 36.45 | 38.46 | 72.31 | 81.13 | — | — | — | — | — | — | — | |
| Mem0Backbone=Qwen3-30B-A3B-Instruct2026.01 | 54.8 | 50 | 87.5 | 33.08 | 36.09 | 76.92 | 82.86 | — | — | — | — | — | — | — | |
| Full TextBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 54.67 | 50 | 87.5 | 33.08 | 35.61 | 76.92 | 82.86 | — | — | — | — | — | — | — | |
| Mem0Backbone=Llama3.1-70B-Instruct2026.01 | 54.62 | 38.33 | 89.29 | 35.88 | 34.15 | 77.18 | 81.43 | — | — | — | — | — | — | — | |
| Mem0Backbone=GPT-4o-mini2026.05 | 53.51 | 60 | 41.07 | 40.15 | 46.21 | 70.12 | 81.43 | — | — | — | — | — | — | — | |
| Full Contextbackbone model=GPT-4o-mini2026.05 | 52.7 | 5.3 | 86.2 | 39.4 | 36.5 | 76.3 | 76.3 | — | — | — | — | — | — | — | |
| Full TextBackbone=Qwen3-30B-A3B-Instruct2026.01 | 51.5 | 62.5 | 88.37 | 27.52 | 34.29 | 66.67 | 81.13 | — | — | — | — | — | — | — | |
| LangMemBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 50.8 | 70 | 42.86 | 37.6 | 38.35 | 67.95 | 78.57 | — | — | — | — | — | — | — | |
| MemoryOSBackbone=Qwen3-30B-A3B-Instruct-25072026.05 | 49.6 | 33.33 | 92.86 | 28.57 | 36.84 | 61.54 | 72.86 | — | — | — | — | — | — | — | |
| MapReduceBackbone=Llama3.1-70B-Instruct2026.01 | 47.25 | 62.5 | 83.72 | 26.61 | 15.24 | 71.21 | 86.79 | — | — | — | — | — | — | — | |
| MemoryOSBackbone=Qwen3-30B-A3B-Instruct2026.01 | 46.75 | 29.17 | 79.07 | 28.44 | 37.14 | 59.09 | 69.81 | — | — | — | — | — | — | — | |
| MemoryOSBackbone=GPT-4o-mini2026.05 | 44.66 | 30 | 64.29 | 32.33 | 31.06 | 48.72 | 80 | — | — | — | — | — | — | — | |
| MIRIX2026.01 | 43.5 | 53.3 | 63.6 | 25.6 | 30.1 | 52.6 | 72.9 | — | — | — | — | — | — | — | |
| MIRIX2026.04 | 43.49 | 53.33 | 63.63 | 25.56 | 30.07 | 52.56 | 72.85 | — | — | — | — | — | — | — | |
| OursBase Model=Qwen2.5-7B-Instruct2026.04 | 38.79 | — | — | 43.53 | 23.14 | 29.22 | — | 67.38 | 69.34 | 14.58 | — | — | — | — | |
| Full TextBackbone=Llama3.1-70B-Instruct2026.01 | 38.75 | 33.33 | 72.09 | 22.02 | 21.9 | 57.58 | 58.49 | — | — | — | — | — | — | — | |
| Mem0Backbone=Qwen3-30B-A3B-Instruct-25072026.05 | 38.67 | 81.82 | 26.09 | 41.94 | 28.13 | 28.57 | 55.32 | — | — | — | — | — | — | — | |
| MemUTokens=0.5k2026.01 | 38.4 | 76.7 | 19.6 | 17.3 | 42.1 | 41 | 67.1 | — | — | — | — | — | — | — | |
| MemU2026.04 | 38.4 | 76.67 | 19.64 | 17.29 | 42.1 | 41.02 | 67.14 | — | — | — | 523 | — | — | — | |
| LangMemBackbone=GPT-4o-mini2026.05 | 37.2 | 60 | 46.43 | 15.79 | 20.3 | 66.67 | 60 | — | — | — | — | — | — | — | |
| MemTreeBase Model=Qwen2.5-7B-Instruct2026.04 | 36.92 | — | — | 41.49 | 21.96 | 29.97 | — | 68.48 | 57.79 | 9.5 | — | — | — | — | |
| MemoryOSBase Model=Qwen2.5-7B-Instruct2026.04 | 32.5 | — | — | 30.62 | 19.35 | 26.34 | — | 56.85 | 61.32 | 12.4 | — | — | — | — | |
| MemOSBase Model=Qwen2.5-7B-Instruct2026.04 | 32.48 | — | — | 33.99 | 22.81 | 21.34 | — | 65.48 | 49.4 | 12.17 | — | — | — | — | |
| Mem0Base Model=Qwen2.5-7B-Instruct2026.04 | 32.46 | — | — | 41.28 | 23.02 | 28.86 | — | 56.51 | 32.35 | 11.44 | — | — | — | — | |
| Mem0^gBase Model=Qwen2.5-7B-Instruct2026.04 | 30.66 | — | — | 40.43 | 24.42 | 29.16 | — | 53.21 | 18.18 | 10.23 | — | — | — | — |