Personalized Generation on PersonaMem 32K memory corpus 1.0 (test)
94.95Revisit ReasonsRecol.
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Recol.Retri Time=7.09ms, Avg. Tokens=3711.12026.03 | 94.95 | 65.47 | 70.59 | 78.18 | 59.65 | 51.94 | 26.88 | 62.14 | |
| RF-MemRetri Time=5.09ms, Avg. Tokens=3566.62026.03 | 94.95 | 66.19 | 70.59 | 78.18 | 61.4 | 56.59 | 26.88 | 63.5 | |
| Full ContextRetri Time=NA, Avg. Tokens=24657.82026.03 | 93.94 | 71.94 | 76.47 | 74.55 | 56.14 | 50.39 | 18.28 | 61.29 | |
| Dense RetrievalRetri Time=3.14ms, Avg. Tokens=3515.92026.03 | 90.91 | 64.75 | 64.71 | 63.64 | 56.14 | 54.26 | 21.51 | 59.08 | |
| Zero MemoryRetri Time=NA, Avg. Tokens=464.62026.03 | 72.73 | 62.59 | 17.65 | 21.82 | 21.05 | 23.26 | 11.83 | 38.54 |