Question Answering on LongMemEval-m
46.64o-J ScoreNano-Memory
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Nano-MemoryAvg. Tokens=4,2612026.04 | 46.6 | 18.09 | 3.96 | 18.88 | 9.03 | 17.4 | 85.1 | |
| MemGASAvg. Tokens=8,8522026.04 | 45.4 | 16.85 | 3.39 | 17.6 | 8.25 | 16.14 | 84.69 | |
| ContrieverAvg. Tokens=8,2742026.04 | 42.8 | 11.88 | 1.66 | 12.63 | 5.51 | 11.11 | 83.31 | |
| SeComAvg. Tokens=2,8212026.04 | 42.8 | 11.33 | 1.79 | 12.03 | 5.07 | 10.49 | 83.36 | |
| MPNetAvg. Tokens=7,9892026.04 | 37.8 | 10.97 | 1.65 | 11.57 | 4.99 | 10.07 | 83.06 | |
| MPCAvg. Tokens=8,4282026.04 | 37.8 | 11.28 | 1.37 | 11.93 | 5.12 | 10.57 | 82.98 | |
| RecurSumAvg. Tokens=8,9272026.04 | 23.8 | 10.04 | 1.7 | 10.89 | 4.26 | 9.21 | 83.12 | |
| Full HistoryAvg. Tokens=128,0002026.04 | 12.2 | 5.7 | 0.78 | 6.27 | 2.08 | 5.28 | 81.62 |