Complex High-Precision Reasoning on LoCoMo (test)
54.17F1 ScoreE-mem
Evaluation results
| Method | Links | ||
|---|---|---|---|
| E-memTS=2271, TL=135, Total Cost=36212026.01 | 54.17 | 44.34 | |
| GAMTS=none, TL=1254, Total Cost=125402026.01 | 45.31 | 37.78 | |
| Mem0TS=none, TL=973, Total Cost=97302026.01 | 45.1 | 34.92 | |
| RAGTS=none, TL=643, Total Cost=64302026.01 | 44.73 | 39.4 | |
| MEMORYOSTS=none, TL=3874, Total Cost=387402026.01 | 42.84 | 35.54 | |
| A-memTS=none, TL=2520, Total Cost=252002026.01 | 39.65 | 32.31 | |
| LIGHTMEMTS=none, TL=612, Total Cost=61202026.01 | 38.44 | 34.37 | |
| Long-ContextTS=none, TL=16910, Total Cost=1691002026.01 | 37.31 | 29.57 |