List your company
ResearchFormerly WizWand

Memory Question Answering on LongMemEval

76AccuracyElasticMem
26.0839.045264.96May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ElasticMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0576378
ElasticMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0568378
MemGenBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0563242
M+Backbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0557198
MemGenBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0555242
LightMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.0553939
MemoryOSBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.055314,489
AutoCompressorBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0551998
M+Backbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0550198
A-MEMBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.055031,489
Mem0Backbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05483,202
MemPBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.054826,580
A-MEMBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.054515,625
LightMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05441,248
AutoCompressorBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.0544998
LangMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.0542781
MemPBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.054126,571
MemoryOSBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.054013,854
MemoryBankBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.053910,822
Mem0Backbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05332,843
MemoryBankBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05299,591
LangMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.0528687