Long-context Question Answering on LoCoMo Open-Domain 2024
54.77F1 ScoreLyzr Cognis
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Lyzr CognisBackbone=GPT-4.12026.03 | 54.77 | 45.12 | 85.85 | |
| ZepBackbone=GPT-4.12026.03 | 49.56 | 38.92 | 76.6 | |
| Mem0gBackbone=GPT-4.12026.03 | 49.27 | 40.3 | 75.71 | |
| Mem0Backbone=GPT-4.12026.03 | 47.65 | 38.72 | 72.93 | |
| A-MemBackbone=GPT-4.12026.03 | 44.65 | 37.06 | — | |
| MemGPTBackbone=GPT-4.12026.03 | 41.04 | 34.34 | — | |
| LangMemBackbone=GPT-4.12026.03 | 40.91 | 33.63 | 71.12 | |
| LoCoMoBackbone=GPT-4.12026.03 | 40.36 | 29.05 | — | |
| OpenAIBackbone=GPT-4.12026.03 | 39.31 | 31.16 | 62.29 | |
| A-Mem*Backbone=GPT-4.12026.03 | 33.34 | 27.58 | 54.05 | |
| ReadAgentBackbone=GPT-4.12026.03 | 9.67 | 7.66 | — | |
| MemoryBankBackbone=GPT-4.12026.03 | 6.61 | 5.16 | — |