Memory Question Answering on LongMemEval
76AccuracyElasticMem
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ElasticMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 76 | 378 | |
| ElasticMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 68 | 378 | |
| MemGenBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 63 | 242 | |
| M+Backbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 57 | 198 | |
| MemGenBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 55 | 242 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 53 | 939 | |
| MemoryOSBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 53 | 14,489 | |
| AutoCompressorBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 51 | 998 | |
| M+Backbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 50 | 198 | |
| A-MEMBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 50 | 31,489 | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 48 | 3,202 | |
| MemPBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 48 | 26,580 | |
| A-MEMBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 45 | 15,625 | |
| LightMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 44 | 1,248 | |
| AutoCompressorBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 44 | 998 | |
| LangMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 42 | 781 | |
| MemPBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 41 | 26,571 | |
| MemoryOSBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 13,854 | |
| MemoryBankBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 39 | 10,822 | |
| Mem0Backbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 33 | 2,843 | |
| MemoryBankBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 29 | 9,591 | |
| LangMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 28 | 687 |