Archival-memory search on FORGETEVAL Adv
95Substring TrapLetta v0.16.7
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Letta v0.16.7Backend=Docker, PostgreSQL+pgvector, LLM usage=no LLM in the loop, Protocol=Direct archival-memory search2026.06 | 95 | 0 | 84 | 90 | 57 | — | 0 | 100 | 100 | 92 | 65.5 | 52.7 | |
| LETHEProtocol=Direct archival-memory search2026.06 | 92 | 82 | 82 | 95 | 100 | 88 | 0 | 5 | 0 | 92 | 63.4 | 63.4 | |
| LetheLLM=DeepSeek-V3.1-Terminus (unused on recall path), Embedder=BAAI/bge-m3, Database=PostgreSQL + pgvector2026.06 | 92 | 82 | 82 | 95 | 100 | 88 | 0 | 5 | 0 | 92 | 63.4 | 63.4 | |
| GraphitiLLM=DeepSeek-V3.1-Terminus, Embedder=BAAI/bge-m3, Cross-encoder=BAAI/bge-reranker-v2-m3, Database=Neo4j 5.x2026.06 | 0 | — | 5 | 0 | 9 | — | 1 | 0 | 0 | 2 | 17 | 17 |