Personalized Generation on PersonaMem 1M memory corpus 1.0 (test)
77.87Revisit ReasonsRF-Mem
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RF-MemRetri Time=6.28ms, Avg. Tokens=3827.82026.03 | 77.87 | 68.89 | 44.92 | 45.36 | 33.9 | 61.11 | 31.5 | 45.89 | |
| Dense RetrievalRetri Time=4.42ms, Avg. Tokens=3816.12026.03 | 77.02 | 69.33 | 45.44 | 44.64 | 30.85 | 59.03 | 30.4 | 45.18 | |
| Recol.Retri Time=8.12ms, Avg. Tokens=3847.42026.03 | 75.32 | 68 | 44.4 | 45 | 35.93 | 58.33 | 31.36 | 45.44 | |
| Zero MemoryRetri Time=NA, Avg. Tokens=415.12026.03 | 60 | 61.78 | 17.97 | 31.79 | 18.31 | 25.69 | 18.16 | 27.3 |