Long-context Question Answering on LoCoMo Temporal 2024
62.68F1 ScoreLyzr Cognis
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Lyzr CognisBackbone=GPT-4.12026.03 | 62.68 | 58.95 | 77.26 | |
| Mem0gBackbone=GPT-4.12026.03 | 51.55 | 40.28 | 58.13 | |
| Mem0Backbone=GPT-4.12026.03 | 48.93 | 40.51 | 55.51 | |
| A-MemBackbone=GPT-4.12026.03 | 45.85 | 36.67 | — | |
| ZepBackbone=GPT-4.12026.03 | 42 | 34.53 | 49.31 | |
| A-Mem*Backbone=GPT-4.12026.03 | 35.4 | 31.08 | 49.91 | |
| LangMemBackbone=GPT-4.12026.03 | 30.75 | 25.84 | 23.43 | |
| MemGPTBackbone=GPT-4.12026.03 | 25.52 | 19.44 | — | |
| LoCoMoBackbone=GPT-4.12026.03 | 18.41 | 14.77 | — | |
| OpenAIBackbone=GPT-4.12026.03 | 14.04 | 11.25 | 21.71 | |
| ReadAgentBackbone=GPT-4.12026.03 | 12.6 | 8.87 | — | |
| MemoryBankBackbone=GPT-4.12026.03 | 9.68 | 6.99 | — |