Open-Domain on LoCoMo
48.38F1 ScoreHIPPOCAMPUS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HIPPOCAMPUS2026.02 | 48.38 | 46.8 | 2.97 | |
| MemoryOS2026.02 | 41.51 | 41.43 | 2.59 | |
| A-mem2026.02 | 41 | 41.41 | 2.72 | |
| MemOS2026.02 | 40.31 | 40.51 | 2.6 | |
| MemGPT2026.02 | 39.74 | 40.03 | 1.92 | |
| Memory R1Model=Llama3.1-8B2026.05 | 29.34 | 24.56 | — | |
| Memory R1Model=Qwen2.5-7B2026.05 | 28.36 | 23.47 | — | |
| GAMModel=GPT-4o-mini2026.04 | 28.12 | 24.51 | — | |
| R2-MemModel=Llama3.1-8B2026.05 | 27.48 | 22.96 | — | |
| R2-MemModel=Qwen2.5-7B2026.05 | 25.06 | 20.78 | — | |
| GAMModel=Qwen2.5-7B2026.05 | 23.82 | 20.19 | — | |
| MemoryOSModel=Llama3.1-8B2026.05 | 23.15 | 15.47 | — | |
| MemoryOSModel=Qwen2.5-7B2026.05 | 22.05 | 16.95 | — | |
| Mem0Model=Llama 3.2-3B2026.04 | 21.33 | 15 | — | |
| GAMModel=Llama 3.2-3B2026.04 | 21.18 | 18.33 | — | |
| GAMModel=Qwen 2.5-7B2026.04 | 21.14 | 17.89 | — | |
| GAMModel=Llama3.1-8B2026.05 | 21.04 | 16.37 | — | |
| Mem0Model=GPT-4o-mini2026.04 | 20.45 | 15.82 | — | |
| GAMModel=Qwen 2.5-14B2026.04 | 20.4 | 18.5 | — | |
| MemoryOSModel=Qwen 2.5-7B2026.04 | 20.22 | 16.12 | — | |
| MemoryOSModel=GPT-4o-mini2026.04 | 20.02 | 16.52 | — | |
| MemoryOSModel=Qwen 2.5-14B2026.04 | 19.27 | 14.96 | — | |
| Mem0Model=Qwen 2.5-7B2026.04 | 18.24 | 15.63 | — | |
| Mem0Model=Qwen 2.5-14B2026.04 | 17.66 | 14.43 | — | |
| A-MEMModel=Llama3.1-8B2026.05 | 17.59 | 12.23 | — | |
| Mem0Model=Qwen2.5-7B2026.05 | 17.33 | 11.58 | — | |
| A-MemModel=Qwen 2.5-14B2026.04 | 16.74 | 14.89 | — | |
| Mem0Model=Llama3.1-8B2026.05 | 16.29 | 10.05 | — | |
| A-MEMModel=Qwen2.5-7B2026.05 | 14.23 | 12.53 | — | |
| A-MemModel=Qwen 2.5-7B2026.04 | 14.16 | 13.06 | — | |
| LIGHTMEMModel=Qwen2.5-7B2026.05 | 13.81 | 10.31 | — | |
| LIGHTMEMModel=Llama3.1-8B2026.05 | 13.31 | 10.61 | — | |
| A-MemModel=Llama 3.2-3B2026.04 | 12.53 | 11.83 | — | |
| A-MemModel=GPT-4o-mini2026.04 | 12.14 | 12 | — | |
| MemgptModel=Qwen 2.5-14B2026.04 | 11.81 | 11.52 | — | |
| MemoryOSModel=Llama 3.2-3B2026.04 | 11.46 | 8.58 | — | |
| RAGModel=Llama3.1-8B2026.05 | 10.58 | 8.31 | — | |
| ReadAgent2026.02 | 9.32 | 8.1 | 1.45 | |
| MemgptModel=GPT-4o-mini2026.04 | 9.15 | 7.44 | — | |
| RAGModel=Qwen2.5-7B2026.05 | 8.97 | 6.55 | — | |
| MemorybankModel=Qwen 2.5-7B2026.04 | 8.53 | 7.58 | — | |
| MemoryBank2026.02 | 7.9 | 7.97 | 2.09 | |
| ReadAgentModel=Llama 3.2-3B2026.04 | 7.53 | 6.39 | — | |
| MemorybankModel=Qwen 2.5-14B2026.04 | 7.33 | 7.45 | — | |
| MemgptModel=Qwen 2.5-7B2026.04 | 6.33 | 5.93 | — | |
| ReadAgentModel=Qwen 2.5-7B2026.04 | 5.86 | 4.78 | — | |
| MemgptModel=Llama 3.2-3B2026.04 | 5.74 | 5.55 | — | |
| MemorybankModel=GPT-4o-mini2026.04 | 5.56 | 5.94 | — | |
| ReadAgentModel=GPT-4o-mini2026.04 | 5.31 | 5.12 | — | |
| ReadAgentModel=Qwen 2.5-14B2026.04 | 4.93 | 5.53 | — | |
| MemorybankModel=Llama 3.2-3B2026.04 | 4.91 | 5.42 | — |