Personalized Generation on PersonaMem 128K memory corpus 1.0 (test)
81.41Revisit ReasonsRecol.
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Recol.Retri Time=7.86ms, Avg. Tokens=3680.32026.03 | 81.41 | 67.16 | 52.54 | 53.01 | 37.65 | 61.4 | 32.63 | 52.88 | |
| RF-MemRetri Time=4.27ms, Avg. Tokens=3565.52026.03 | 80.3 | 68.62 | 54.27 | 53.58 | 41.31 | 62.57 | 32.63 | 53.94 | |
| Dense RetrievalRetri Time=3.24ms, Avg. Tokens=3540.12026.03 | 78.81 | 68.04 | 53.46 | 53.3 | 36.62 | 60.82 | 30.69 | 52.59 | |
| Zero MemoryRetri Time=NA, Avg. Tokens=416.32026.03 | 67.66 | 64.22 | 21.36 | 27.51 | 19.25 | 22.81 | 17.37 | 31.24 | |
| Full ContextRetri Time=NA, Avg. Tokens=115601.42026.03 | 56.13 | 39.3 | 27.83 | 38.68 | 27.7 | 39.77 | 17.95 | 32.31 |