Information Retrieval on LongMemEval-S (cross-benchmark replication Full-500)
0.683Precision@5letta
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| lettaEmbedding backbone=nomic-embed-text (768-dim), Retrieval top-k=5, Retrieval seeds=42, n=441, Note=Retrieval metrics averaged over successful queries2026.04 | 0.683 | 0.201 | 0.834 | 0.715 | 0.287 | |
| zenbrainEmbedding backbone=nomic-embed-text (768-dim), Retrieval top-k=5, Retrieval seeds=42, 123, 456, n=5002026.04 | 0.674 | 0.197 | 0.831 | 0.706 | 0.283 | |
| a-memEmbedding backbone=nomic-embed-text (768-dim), Retrieval top-k=5, Retrieval seeds=42, n=5002026.04 | 0.519 | 0.144 | 0.64 | 0.543 | 0.211 | |
| mem0Embedding backbone=nomic-embed-text (768-dim), Retrieval top-k=5, Retrieval seeds=42, n=4962026.04 | 0.156 | 0.06 | 0.304 | 0.171 | 0.078 |