Overall Reasoning (Average) on LoCoMo
44.68F1 Score (LoCoMo)SCG-Mem (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCG-Mem (Ours)Model=Llama 3.2 1B2026.04 | 44.68 | 36.21 | |
| GAMModel=GPT-4o-mini2026.04 | 43.14 | 36.48 | |
| SCG-Mem (Ours)Model=Qwen2.5 3B2026.04 | 41.48 | 33.46 | |
| SCG-Mem (Ours)Model=Llama 3.2 3B2026.04 | 40.8 | 33.22 | |
| GAMModel=Qwen 2.5-14B2026.04 | 40.38 | 33.55 | |
| Mem0Model=GPT-4o-mini2026.04 | 40.37 | 31.45 | |
| GAMModel=Qwen 2.5-7B2026.04 | 40 | 32.99 | |
| SCG-Mem (Ours)Model=Qwen2.5 1.5B2026.04 | 37.89 | 31.73 | |
| Mem0Model=Qwen 2.5-14B2026.04 | 37.29 | 30.66 | |
| GAMModel=Llama 3.2-3B2026.04 | 36.27 | 30.02 | |
| MemoryOSModel=GPT-4o-mini2026.04 | 36.27 | 28.87 | |
| Mem0Model=Qwen 2.5-7B2026.04 | 35.38 | 28.67 | |
| A-MemModel=GPT-4o-mini2026.04 | 32.41 | 26.45 | |
| A-MEMModel=Llama 3.2 1B2026.04 | 31.05 | 25.1 | |
| Mem0Model=Llama 3.2-3B2026.04 | 30.11 | 21.28 | |
| MemoryOSModel=Qwen 2.5-7B2026.04 | 28.86 | 22.25 | |
| A-MEMModel=Llama 3.2 3B2026.04 | 28.5 | 23.93 | |
| A-MEMModel=Qwen2.5 1.5B2026.04 | 28.05 | 23.54 | |
| A-MemModel=Qwen 2.5-14B2026.04 | 27.14 | 21.76 | |
| MemgptModel=GPT-4o-mini2026.04 | 25.59 | 19.73 | |
| A-MemModel=Qwen 2.5-7B2026.04 | 24.2 | 19.49 | |
| MemoryOSModel=Qwen 2.5-14B2026.04 | 24.11 | 18.2 | |
| MemoryBankModel=Llama 3.2 1B2026.04 | 22.68 | 19.47 | |
| A-MEMModel=Qwen2.5 3B2026.04 | 21.33 | 18.09 | |
| A-MemModel=Llama 3.2-3B2026.04 | 21.12 | 16.73 | |
| LoCoMoModel=Llama 3.2 1B2026.04 | 20.85 | 18.69 | |
| MemoryOSModel=Llama 3.2-3B2026.04 | 20.03 | 14.02 | |
| MemGPTModel=Llama 3.2 1B2026.04 | 18.28 | 16.14 | |
| MemoryBankModel=Qwen2.5 1.5B2026.04 | 16.45 | 14.03 | |
| LoCoMoModel=Qwen2.5 1.5B2026.04 | 16.21 | 14.87 | |
| ReadAgentModel=Llama 3.2 1B2026.04 | 15.07 | 13.4 | |
| MemGPTModel=Qwen2.5 1.5B2026.04 | 13.93 | 11.94 | |
| LoCoMoModel=Llama 3.2 3B2026.04 | 12.47 | 11.39 | |
| ReadAgentModel=GPT-4o-mini2026.04 | 9.18 | 7.03 | |
| MemoryBankModel=Llama 3.2 3B2026.04 | 8.99 | 7.67 | |
| MemgptModel=Qwen 2.5-14B2026.04 | 8.98 | 7.59 | |
| MemGPTModel=Llama 3.2 3B2026.04 | 8.44 | 7.4 | |
| LoCoMoModel=Qwen2.5 3B2026.04 | 7.93 | 6.88 | |
| MemGPTModel=Qwen2.5 3B2026.04 | 7.44 | 6.29 | |
| MemorybankModel=GPT-4o-mini2026.04 | 6.71 | 5.71 | |
| MemorybankModel=Llama 3.2-3B2026.04 | 6.23 | 5.3 | |
| ReadAgentModel=Qwen2.5 1.5B2026.04 | 6.18 | 10.58 | |
| ReadAgentModel=Qwen2.5 3B2026.04 | 6.13 | 5.33 | |
| ReadAgentModel=Llama 3.2 3B2026.04 | 6.13 | 5.33 | |
| MemgptModel=Llama 3.2-3B2026.04 | 6.12 | 5.11 | |
| MemgptModel=Qwen 2.5-7B2026.04 | 5.91 | 5.25 | |
| MemorybankModel=Qwen 2.5-7B2026.04 | 5.88 | 5.03 | |
| MemoryBankModel=Qwen2.5 3B2026.04 | 5.63 | 4.75 | |
| ReadAgentModel=Qwen 2.5-7B2026.04 | 4.82 | 3.92 | |
| MemorybankModel=Qwen 2.5-14B2026.04 | 4.57 | 4.17 | |
| ReadAgentModel=Llama 3.2-3B2026.04 | 4.36 | 3.86 | |
| ReadAgentModel=Qwen 2.5-14B2026.04 | 4.27 | 3.82 |