Single-Hop on LoCoMo
59.03F1 ScoreR2-Mem
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| R2-MemModel=Qwen2.5-7B2026.05 | 59.03 | 53.13 | — | |
| GAMModel=Qwen2.5-7B2026.05 | 56.03 | 49.59 | — | |
| R2-MemModel=Llama3.1-8B2026.05 | 52.16 | 45.73 | — | |
| GAMModel=Llama3.1-8B2026.05 | 50.88 | 44.58 | — | |
| SCG-Mem (Ours)Model=Llama 3.2 3B2026.04 | 44.39 | 37.71 | — | |
| SCG-Mem (Ours)Model=Qwen2.5 3B2026.04 | 42.51 | 32.14 | — | |
| SCG-Mem (Ours)Model=Llama 3.2 1B2026.04 | 41.19 | 32.17 | — | |
| MemOS2026.02 | 39.24 | 40.76 | 2.75 | |
| MemoryOSModel=Llama3.1-8B2026.05 | 38.43 | 30.15 | — | |
| Memory R1Model=Llama3.1-8B2026.05 | 37.02 | 31.23 | — | |
| MemoryOSModel=Qwen2.5-7B2026.05 | 36.15 | 28.15 | — | |
| Memory R1Model=Qwen2.5-7B2026.05 | 35.64 | 28.06 | — | |
| HIPPOCAMPUS2026.02 | 34.36 | 30.04 | 3.08 | |
| LIGHTMEMModel=Llama3.1-8B2026.05 | 33.26 | 29.25 | — | |
| LIGHTMEMModel=Qwen2.5-7B2026.05 | 32.92 | 26.11 | — | |
| MemoryOS2026.02 | 32.5 | 30.13 | 2.76 | |
| SCG-Mem (Ours)Model=Qwen2.5 1.5B2026.04 | 31.18 | 21.34 | — | |
| Mem0Model=Llama3.1-8B2026.05 | 29.12 | 21.64 | — | |
| Mem0Model=Qwen2.5-7B2026.05 | 28.96 | 22.45 | — | |
| A-MEMModel=Llama 3.2 1B2026.04 | 28.51 | 24.13 | — | |
| A-MEMModel=Llama 3.2 3B2026.04 | 28.14 | 23.87 | — | |
| MemGPT2026.02 | 25.43 | 17.68 | 1.91 | |
| A-MEMModel=Qwen2.5 1.5B2026.04 | 23.63 | 19.23 | — | |
| A-MEMModel=Llama3.1-8B2026.05 | 21.55 | 16.23 | — | |
| A-MEMModel=Qwen2.5-7B2026.05 | 19.96 | 13.56 | — | |
| A-mem2026.02 | 19.82 | 19.86 | 2.66 | |
| MemoryBankModel=Llama 3.2 1B2026.04 | 17.3 | 14.03 | — | |
| A-MEMModel=Qwen2.5 3B2026.04 | 17.23 | 13.12 | — | |
| MemoryBankModel=Qwen2.5 1.5B2026.04 | 13.42 | 11.01 | — | |
| LoCoMoModel=Llama 3.2 1B2026.04 | 12.86 | 10.5 | — | |
| RAGModel=Llama3.1-8B2026.05 | 12.29 | 9.57 | — | |
| LoCoMoModel=Qwen2.5 1.5B2026.04 | 11.15 | 8.67 | — | |
| MemGPTModel=Llama 3.2 1B2026.04 | 10.16 | 7.68 | — | |
| ReadAgentModel=Qwen2.5 1.5B2026.04 | 10.13 | 7.54 | — | |
| RAGModel=Qwen2.5-7B2026.05 | 9.86 | 7.5 | — | |
| MemGPTModel=Qwen2.5 1.5B2026.04 | 9.56 | 7.34 | — | |
| ReadAgent2026.02 | 8.78 | 5.93 | 1.03 | |
| LoCoMoModel=Llama 3.2 3B2026.04 | 8.37 | 6.93 | — | |
| ReadAgentModel=Llama 3.2 1B2026.04 | 7.75 | 6.03 | — | |
| MemoryBankModel=Llama 3.2 3B2026.04 | 7.61 | 6.03 | — | |
| MemGPTModel=Qwen2.5 3B2026.04 | 7.26 | 5.52 | — | |
| LoCoMoModel=Qwen2.5 3B2026.04 | 7.03 | 5.69 | — | |
| MemoryBank2026.02 | 5.05 | 3.97 | 2 | |
| MemGPTModel=Llama 3.2 3B2026.04 | 4.32 | 3.51 | — | |
| MemoryBankModel=Qwen2.5 3B2026.04 | 4.11 | 3.32 | — | |
| ReadAgentModel=Qwen2.5 3B2026.04 | 3.25 | 2.51 | — | |
| ReadAgentModel=Llama 3.2 3B2026.04 | 3.25 | 2.51 | — |