Long-context Question Answering on LoCoMo Multi-Hop 2024
31.51F1 ScoreLyzr Cognis
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Lyzr CognisBackbone=GPT-4.12026.03 | 31.51 | 23.22 | 51.04 | |
| Mem0Backbone=GPT-4.12026.03 | 28.64 | 21.58 | 51.15 | |
| LangMemBackbone=GPT-4.12026.03 | 26.04 | 22.32 | 47.92 | |
| Mem0gBackbone=GPT-4.12026.03 | 24.32 | 18.82 | 47.19 | |
| OpenAIBackbone=GPT-4.12026.03 | 20.09 | 15.42 | 42.92 | |
| ZepBackbone=GPT-4.12026.03 | 19.37 | 14.82 | 41.35 | |
| A-MemBackbone=GPT-4.12026.03 | 12.14 | 12 | — | |
| LoCoMoBackbone=GPT-4.12026.03 | 12.04 | 11.16 | — | |
| A-Mem*Backbone=GPT-4.12026.03 | 9.22 | 8.81 | 18.85 | |
| MemGPTBackbone=GPT-4.12026.03 | 9.15 | 7.44 | — | |
| MemoryBankBackbone=GPT-4.12026.03 | 5.56 | 5.94 | — | |
| ReadAgentBackbone=GPT-4.12026.03 | 5.31 | 5.12 | — |