Temporal on LoCoMo
0.4935F1 ScoreSCG-Mem (Ours)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SCG-Mem (Ours)Model=Llama 3.2 3B2026.04 | 0.4935 | 0.3427 | — | |
| R2-MemModel=Llama3.1-8B2026.05 | 0.4753 | 0.4214 | — | |
| R2-MemModel=Qwen2.5-7B2026.05 | 0.4676 | 0.4067 | — | |
| SCG-Mem (Ours)Model=Qwen2.5 3B2026.04 | 0.4229 | 0.3172 | — | |
| Memory R1Model=Llama3.1-8B2026.05 | 0.4126 | 0.2904 | — | |
| GAMModel=Llama3.1-8B2026.05 | 0.3966 | 0.3307 | — | |
| Memory R1Model=Qwen2.5-7B2026.05 | 0.3905 | 0.2603 | — | |
| HIPPOCAMPUS2026.02 | 0.383 | 0.3735 | 2.94 | |
| SCG-Mem (Ours)Model=Llama 3.2 1B2026.04 | 0.3764 | 0.2492 | — | |
| A-mem2026.02 | 0.3463 | 0.3487 | 2.18 | |
| Mem0Model=Llama3.1-8B2026.05 | 0.3424 | 0.2491 | — | |
| Mem0Model=Qwen2.5-7B2026.05 | 0.3326 | 0.2468 | — | |
| LIGHTMEMModel=Qwen2.5-7B2026.05 | 0.3216 | 0.2632 | — | |
| GAMModel=Qwen2.5-7B2026.05 | 0.311 | 0.2657 | — | |
| MemOS2026.02 | 0.3106 | 0.3134 | 2.81 | |
| LIGHTMEMModel=Llama3.1-8B2026.05 | 0.3103 | 0.2581 | — | |
| SCG-Mem (Ours)Model=Qwen2.5 1.5B2026.04 | 0.2833 | 0.2116 | — | |
| A-MEMModel=Qwen2.5 3B2026.04 | 0.2759 | 0.2507 | — | |
| MemGPT2026.02 | 0.2648 | 0.2619 | 1.02 | |
| A-MEMModel=Llama 3.2 3B2026.04 | 0.2638 | 0.195 | — | |
| MemoryOSModel=Llama3.1-8B2026.05 | 0.2622 | 0.1696 | — | |
| MemoryOSModel=Qwen2.5-7B2026.05 | 0.2565 | 0.1819 | — | |
| MemoryOS2026.02 | 0.2508 | 0.2508 | 2.61 | |
| A-MEMModel=Qwen2.5 1.5B2026.04 | 0.2432 | 0.1974 | — | |
| A-MEMModel=Llama3.1-8B2026.05 | 0.1857 | 0.1336 | — | |
| A-MEMModel=Llama 3.2 1B2026.04 | 0.178 | 0.1028 | — | |
| A-MEMModel=Qwen2.5-7B2026.05 | 0.1769 | 0.1319 | — | |
| ReadAgent2026.02 | 0.1124 | 0.1112 | 1.08 | |
| MemoryBank2026.02 | 0.0985 | 0.0992 | 1.03 | |
| RAGModel=Llama3.1-8B2026.05 | 0.0957 | 0.0834 | — | |
| RAGModel=Qwen2.5-7B2026.05 | 0.0865 | 0.0794 | — | |
| MemoryBankModel=Llama 3.2 1B2026.04 | 0.0761 | 0.0627 | — | |
| LoCoMoModel=Llama 3.2 1B2026.04 | 0.0738 | 0.0682 | — | |
| MemoryBankModel=Qwen2.5 1.5B2026.04 | 0.0446 | 0.0287 | — | |
| LoCoMoModel=Llama 3.2 3B2026.04 | 0.0437 | 0.044 | — | |
| LoCoMoModel=Qwen2.5 1.5B2026.04 | 0.0425 | 0.0404 | — | |
| MemGPTModel=Qwen2.5 1.5B2026.04 | 0.0421 | 0.0389 | — | |
| MemGPTModel=Llama 3.2 1B2026.04 | 0.0402 | 0.0479 | — | |
| MemoryBankModel=Llama 3.2 3B2026.04 | 0.0349 | 0.0313 | — | |
| LoCoMoModel=Qwen2.5 3B2026.04 | 0.0311 | 0.0271 | — | |
| ReadAgentModel=Qwen2.5 3B2026.04 | 0.0301 | 0.0301 | — | |
| ReadAgentModel=Llama 3.2 3B2026.04 | 0.0301 | 0.0301 | — | |
| MemGPTModel=Qwen2.5 3B2026.04 | 0.0294 | 0.0295 | — | |
| MemGPTModel=Llama 3.2 3B2026.04 | 0.0268 | 0.0272 | — | |
| ReadAgentModel=Qwen2.5 1.5B2026.04 | 0.0255 | 0.0251 | — | |
| ReadAgentModel=Llama 3.2 1B2026.04 | 0.0193 | 0.023 | — | |
| MemoryBankModel=Qwen2.5 3B2026.04 | 0.0172 | 0.0197 | — |