Reasoning on LOCOMO
26.6Token F1Engram J-OPT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Engram J-OPTanswering LM=d202026.06 | 26.6 | 58 | |
| Engram J-OPTanswering LM=d12@12802026.06 | 20.3 | 49 | |
| Engram J-OPTanswering LM=d12 v22026.06 | 18.3 | 56 | |
| MEMMACHanswering LM=d202026.06 | 16.8 | — | |
| MEMMACHanswering LM=d12@12802026.06 | 13.6 | — | |
| MEM0answering LM=d202026.06 | 13.5 | — | |
| MEM0answering LM=d12@12802026.06 | 12.3 | — | |
| MEM0answering LM=d12 v22026.06 | 11.7 | — | |
| MEMMACHanswering LM=d12 v22026.06 | 11.3 | — |