Long-term Reasoning on LoCoMo
77.4LLM ScoreAMA
Evaluation results
| Method | Links | |
|---|---|---|
| AMATokens=3613, Latency (s)=3.91, Kr=22026.01 | 77.4 | |
| NemoriTokens=2925, Latency (s)=3.1522026.01 | 74 | |
| AMATokens=2491, Latency (s)=3.124, Kr=12026.01 | 72.3 | |
| FullContextTokens=18625, Latency (s)=7.2062026.01 | 71.7 | |
| Mem0Tokens=1340, Latency (s)=3.7392026.01 | 60.8 | |
| ZepTokens=2461, Latency (s)=3.2552026.01 | 58 | |
| A-MemTokens=2720, Latency (s)=3.2272026.01 | 47.6 | |
| RAGTokens=5800, Latency (s)=2.9832026.01 | 30 |