Adversarial on LoCoMo
71.99F1 ScoreSCG-Mem (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCG-Mem (Ours)Model=Qwen2.5 1.5B2026.04 | 71.99 | 68.21 | |
| SCG-Mem (Ours)Model=Llama 3.2 1B2026.04 | 63.21 | 58.69 | |
| A-MEMModel=Llama 3.2 1B2026.04 | 58.81 | 54.28 | |
| SCG-Mem (Ours)Model=Qwen2.5 3B2026.04 | 52.63 | 48.76 | |
| MemoryBankModel=Llama 3.2 1B2026.04 | 52.61 | 47.53 | |
| LoCoMoModel=Llama 3.2 1B2026.04 | 51.89 | 48.27 | |
| MemGPTModel=Llama 3.2 1B2026.04 | 49.75 | 45.11 | |
| SCG-Mem (Ours)Model=Llama 3.2 3B2026.04 | 49.3 | 48.23 | |
| A-MEMModel=Qwen2.5 1.5B2026.04 | 46 | 43.26 | |
| ReadAgentModel=Llama 3.2 1B2026.04 | 44.64 | 40.15 | |
| A-MEMModel=Llama 3.2 3B2026.04 | 42.04 | 40.6 | |
| LoCoMoModel=Qwen2.5 1.5B2026.04 | 40.38 | 40.23 | |
| MemoryBankModel=Qwen2.5 1.5B2026.04 | 36.76 | 34 | |
| MemGPTModel=Qwen2.5 1.5B2026.04 | 31.51 | 28.9 | |
| LoCoMoModel=Llama 3.2 3B2026.04 | 30.25 | 28.46 | |
| A-MEMModel=Qwen2.5 3B2026.04 | 27.91 | 25.15 | |
| MemGPTModel=Llama 3.2 3B2026.04 | 21.45 | 19.37 | |
| MemoryBankModel=Llama 3.2 3B2026.04 | 18.65 | 17.05 | |
| LoCoMoModel=Qwen2.5 3B2026.04 | 16.95 | 14.81 | |
| ReadAgentModel=Qwen2.5 3B2026.04 | 15.78 | 14.01 | |
| ReadAgentModel=Llama 3.2 3B2026.04 | 15.78 | 14.01 | |
| MemGPTModel=Qwen2.5 3B2026.04 | 14.47 | 12.39 | |
| MemoryBankModel=Qwen2.5 3B2026.04 | 13.07 | 10.3 | |
| ReadAgentModel=Qwen2.5 1.5B2026.04 | 5.42 | 27.32 |