Query-Answering on PersonaMem 128K context length
70Query-Answering AccuracyCoMAM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CoMAMBackbone=Qwen2026.03 | 70 | — | |
| CoMAMBackbone=Llama2026.03 | 68 | — | |
| Memory-R1Backbone=Llama2026.03 | 61 | — | |
| Memory-R1Backbone=Qwen2026.03 | 60 | — | |
| Mem1Backbone=Llama2026.03 | 58 | — | |
| Mem1Backbone=Qwen2026.03 | 57 | — | |
| CAMBackbone=Qwen2026.03 | 50 | — | |
| MemoryBankBackbone=Qwen2026.03 | 47 | — | |
| RAGBackbone=Qwen2026.03 | 45 | — | |
| CAMBackbone=Llama2026.03 | 45 | — | |
| A-MemBackbone=Qwen2026.03 | 44 | — | |
| MemoryBankBackbone=Llama2026.03 | 42 | — | |
| BaseBackbone=Qwen2026.03 | 39 | — | |
| RAGBackbone=Llama2026.03 | 39 | — | |
| A-MemBackbone=Llama2026.03 | 37 | — | |
| BaseBackbone=Llama2026.03 | 31 | — | |
| ElasticMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.84 | 539 | |
| ElasticMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.77 | 539 | |
| TreeMemBackbone=Qwen2026.05 | 0.75 | — | |
| TreeMemBackbone=Llama2026.05 | 0.74 | — | |
| CoMAMBackbone=Qwen2026.05 | 0.7 | — | |
| CoMAMBackbone=Llama2026.05 | 0.68 | — | |
| Mem-αBackbone=Qwen2026.05 | 0.67 | — | |
| Mem-αBackbone=Llama2026.05 | 0.66 | — | |
| MemGenBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.66 | 393 | |
| Memory-R1Backbone=Llama2026.05 | 0.61 | — | |
| Memory-R1Backbone=Qwen2026.05 | 0.6 | — | |
| M+Backbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.59 | 350 | |
| Mem1Backbone=Llama2026.05 | 0.58 | — | |
| MemGenBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.58 | 393 | |
| Mem1Backbone=Qwen2026.05 | 0.57 | — | |
| Mem0Backbone=Qwen2026.05 | 0.55 | — | |
| M+Backbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.52 | 350 | |
| AutoCompressorBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.52 | 1,127 | |
| CAMBackbone=Qwen2026.05 | 0.5 | — | |
| Mem0Backbone=Llama2026.05 | 0.49 | — | |
| MemoryBankBackbone=Qwen2026.05 | 0.47 | — | |
| RAGBackbone=Qwen2026.05 | 0.45 | — | |
| CAMBackbone=Llama2026.05 | 0.45 | — | |
| AutoCompressorBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 0.45 | 1,127 | |
| A-MemBackbone=Qwen2026.05 | 0.44 | — | |
| MemoryBankBackbone=Llama2026.05 | 0.42 | — | |
| LangMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.42 | 3,097 | |
| MemPBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.4 | 29,581 | |
| BaseBackbone=Qwen2026.05 | 0.39 | — | |
| RAGBackbone=Llama2026.05 | 0.39 | — | |
| Mem0Backbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.39 | 662 | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.39 | 676 | |
| A-MEMBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.38 | 3,530 | |
| MemPBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.38 | 29,567 | |
| MemoryOSBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.38 | 9,748 | |
| A-MemBackbone=Llama2026.05 | 0.37 | — | |
| A-MEMBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.37 | 11,098 | |
| LightMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.35 | 1,306 | |
| MemoryBankBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.35 | 4,724 | |
| MemoryBankBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.33 | 4,618 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.33 | 1,228 | |
| MemoryOSBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.32 | 9,440 | |
| BaseBackbone=Llama2026.05 | 0.31 | — | |
| LangMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 0.3 | 1,626 |