Question Answering on LoCoMo Multi-Hop
38.72F1 ScoreMem0
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Mem0Token Usage=17642026.03 | 38.72 | 27.13 | — | |
| TA-MemToken Usage=37552026.03 | 35.62 | 27.84 | — | |
| AriadneMem2026.07 | 35.4 | 30.9 | 33.89 | |
| MemoryOSToken Usage=38742026.03 | 35.27 | 25.22 | — | |
| SeCom2026.07 | 28.09 | 20.47 | 62.66 | |
| A-MemToken Usage=25202026.03 | 27.02 | 20.09 | — | |
| MemGPTToken Usage=169772026.03 | 26.65 | 17.72 | — | |
| LoCoMoToken Usage=169102026.03 | 25.02 | 19.75 | — | |
| Graphiti/ZepA-TMA=true2026.07 | 23.98 | 18.01 | 58.74 | |
| InsideOutA-TMA=true2026.07 | 22.83 | 15.58 | 51.72 | |
| A-MemA-TMA=false2026.07 | 21.79 | 15.92 | 58.58 | |
| A-MemA-TMA=true2026.07 | 21.36 | 15.1 | 57.4 | |
| M+2026.07 | 19.87 | 14.64 | 41.02 | |
| MemoryLLM2026.07 | 19.77 | 14.61 | 40.9 | |
| Graphiti/ZepA-TMA=false2026.07 | 12.31 | 9.51 | 39.24 | |
| ReadAgentToken Usage=6432026.03 | 9.15 | 6.48 | — | |
| AtomMem2026.07 | 8.87 | 5.13 | 42.57 | |
| InsideOutA-TMA=false2026.07 | 5.54 | 3.81 | 31.87 | |
| MemoryBankToken Usage=4322026.03 | 5 | 4.77 | — | |
| Mem02026.07 | 3.75 | 2.64 | 50.65 |