Recommendation on Books N=20 (test)
42.36Hit Rate @ 1MemRec
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MemRecCandidate Set Size (N)=202026.01 | 42.36 | 63.51 | 53.32 | 76.67 | 57.56 | |
| i2AgentCandidate Set Size (N)=202026.01 | 37.12 | 59.47 | 48.74 | 73.87 | 53.36 | |
| iAgentCandidate Set Size (N)=202026.01 | 32.58 | 50.69 | 41.73 | 62.09 | 45.37 | |
| RecBotCandidate Set Size (N)=202026.01 | 24.71 | 40.3 | 32.47 | 57.68 | 38.01 | |
| AgentCFCandidate Set Size (N)=202026.01 | 24.7 | 54.81 | 40.26 | 72.5 | 45.94 | |
| Vanilla LLMCandidate Set Size (N)=202026.01 | 17.3 | 41.55 | 29.55 | 61.29 | 35.99 | |
| P5Candidate Set Size (N)=202026.01 | 16.48 | 30.51 | 23.31 | 52.16 | 30.22 | |
| LightGCNCandidate Set Size (N)=202026.01 | 12.76 | 26.22 | 19.47 | 55.12 | 28.54 | |
| SASRecCandidate Set Size (N)=202026.01 | 4.53 | 23.53 | 13.78 | 48.96 | 21.88 |