Long-context Memory Modeling on LoCoMo
69.54AccuracyAnchorMem
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AnchorMemBackbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 69.54 | 2,340.35 | 5,129.1 | 7,469.45 | 6,577 | 5,073.75 | |
| LightMemBackbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 59.87 | 951.12 | 178.5 | 1,129.62 | 538 | 8,144.3 | |
| HippoRAG 2Backbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 59.48 | 4,880.35 | 4,673.47 | 9,553.83 | 12,760 | 5,410.16 | |
| MemoryOSBackbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 48.31 | 1,762.96 | 2,462.42 | 4,225.38 | 14,318 | 28,262.44 | |
| A-MemBackbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 42.92 | 2,048.29 | 12,527 | 14,575.3 | 11,763 | 99,252.15 | |
| Mem0Backbone=Qwen2.5-32B-Instruct, Retrieval top-k=10, Embedding model=all-MiniLM-L6-v22026.04 | 33.88 | 5,902.29 | 8,542.92 | 14,445.2 | 10,147 | 6,200.04 |