Retrieval on LoCoMo real Retrieval post-G4
0.099Precision@5mem0
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| mem0Embedding backbone=nomic-embed-text, Retrieval seeds=42, 123, 456, LLM-as-Judge rubric=0-5 rubric, LLM-as-Judge temperature=0, Judge evaluation protocol=S-4.5/G-4o/O-4.6: mean-over-3-seeds2026.04 | 0.099 | 0.452 | 0.207 | 0.306 | 0.162 | 0.353 | 0.446 | 0.35 | |
| lettaEmbedding backbone=nomic-embed-text, Retrieval seeds=42, 123, 456, LLM-as-Judge rubric=0-5 rubric, LLM-as-Judge temperature=0, Judge evaluation protocol=S-4.5/G-4o: mean-over-3-seeds; O-4.6: seed=422026.04 | 0.092 | 0.4 | 0.307 | 0.319 | 0.15 | 0.373 | 0.465 | 0.427 | |
| zenbrainEmbedding backbone=nomic-embed-text, Retrieval seeds=42, 123, 456, LLM-as-Judge rubric=0-5 rubric, LLM-as-Judge temperature=0, Judge evaluation protocol=S-4.5/G-4o: mean-over-3-seeds; O-4.6: seed=422026.04 | 0.081 | 0.351 | 0.264 | 0.274 | 0.128 | 0.38 | 0.451 | 0.415 | |
| a-memEmbedding backbone=nomic-embed-text, Retrieval seeds=42, 123, 456, LLM-as-Judge rubric=0-5 rubric, LLM-as-Judge temperature=0, Judge evaluation protocol=S-4.5/G-4o: mean-over-3-seeds; O-4.6: seed=422026.04 | 0.044 | 0.193 | 0.128 | 0.14 | 0.072 | 0.218 | 0.309 | 0.222 |