Memory Question Answering on LoCoMo
84AccuracyElasticMem
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ElasticMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 84 | 334 | |
| ElasticMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 74 | 334 | |
| MemGenBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 68 | 198 | |
| M+Backbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 62 | 154 | |
| MemGenBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 60 | 198 | |
| AutoCompressorBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 55 | 234 | |
| M+Backbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 54 | 154 | |
| AutoCompressorBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 47 | 234 | |
| A-MEMBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 42 | 3,289 | |
| MemoryOSBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 42 | 4,998 | |
| MemoryBankBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 41 | 2,202 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 41 | 3,702 | |
| LightMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 3,468 | |
| LangMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 936 | |
| MemoryBankBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 2,301 | |
| A-MEMBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 39 | 3,348 | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 38 | 921 | |
| LangMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 35 | 1,478 | |
| Mem0Backbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 33 | 836 | |
| MemoryOSBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 33 | 4,420 | |
| MemPBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 26 | 5,140 | |
| MemPBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 22 | 5,382 |