Memory reasoning on Splitwise
95.2Accuracyxmemory
Evaluation results
| Method | Links | |
|---|---|---|
| xmemoryEvaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 95.2 | |
| Frontier-model applicationsType=customer-facing memory and tool-use harnesses2026.04 | 92 | |
| SupermemoryEvaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 73.75 | |
| CogneeEvaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 68 | |
| Mem0Graph usage=true, Evaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 59.1 | |
| Mem0Graph usage=false, Evaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 54.9 | |
| Markdown harness (balance-only)Type=File-based Markdown, Model=frontier model2026.04 | 40 | |
| ZepEvaluation protocol=single-answer, Judge type=LLM as a judge2026.04 | 25.7 | |
| Markdown harness (transaction-preserving)Type=File-based Markdown, Model=frontier model2026.04 | 12 |