Long-term Conversational Memory Question Answering on LoCoMo
43.94F1 ScoreLongLLMLingua
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LongLLMLinguaCompression Ratio=4x2026.05 | 43.94 | 501.8 | 1,504.6 | 2,006.4 | 22.79 | — | |
| TaC-CCompression Ratio=4x2026.05 | 41.94 | 77.9 | 402.7 | 480.6 | 1.13 | — | |
| LLMLingua-2Compression Ratio=4x2026.05 | 31.53 | 241.9 | 449.2 | 691.1 | 21.11 | — | |
| SEGTREEMEM-TDMemory Structure Type=Segment Tree, Propagation Direction=Top-down, Alpha (α)=0.10, Horizon (H)=2, LLM Construction Setting=batch2026.06 | 30.8 | — | — | — | — | 63.6 | |
| SEGTREEMEM-BUMemory Structure Type=Segment Tree, Propagation Direction=Bottom-up, Alpha (α)=0.10, Horizon (H)=2, LLM Construction Setting=batch2026.06 | 30.1 | — | — | — | — | 63.9 | |
| A-MEMMemory Structure Type=Graph-structured2026.06 | 23.1 | — | — | — | — | 60.8 | |
| RAPTORMemory Structure Type=Tree-structured2026.06 | 22.3 | — | — | — | — | 59.3 | |
| HippoRAGMemory Structure Type=Graph-structured2026.06 | 21.8 | — | — | — | — | 57 | |
| DenseMemory Structure Type=Retrieval-only2026.06 | 18.8 | — | — | — | — | 49 | |
| Mem0Memory Structure Type=Graph-structured2026.06 | 18.7 | — | — | — | — | 45.4 | |
| BM25Memory Structure Type=Retrieval-only2026.06 | 18.4 | — | — | — | — | 46.9 | |
| MemTreeMemory Structure Type=Tree-structured2026.06 | 15.1 | — | — | — | — | 48.3 | |
| PCCCompression Ratio=4x2026.05 | 14.17 | 239.5 | 423.4 | 662.9 | 25.14 | — |