Recommendation on Yelp N=20 (test)
36.2Hit Rate @1MemRec
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MemRecCandidate Set Size (N)=202026.01 | 36.2 | 63.29 | 50.35 | 77.08 | 54.78 | |
| i^2AgentCandidate Set Size (N)=202026.01 | 32.87 | 60.83 | 47.44 | 75.62 | 52.16 | |
| iAgentCandidate Set Size (N)=202026.01 | 32.36 | 56.58 | 44.99 | 65.97 | 47.99 | |
| LightGCNCandidate Set Size (N)=202026.01 | 25.49 | 54.37 | 40.46 | 74.81 | 46.92 | |
| RecBotCandidate Set Size (N)=202026.01 | 19.49 | 37.42 | 28.51 | 55.19 | 34.14 | |
| SASRecCandidate Set Size (N)=202026.01 | 16.78 | 39.93 | 28.79 | 55.9 | 33.89 | |
| AgentCFCandidate Set Size (N)=202026.01 | 11.15 | 38.97 | 25.12 | 63.72 | 33.09 | |
| P5Candidate Set Size (N)=202026.01 | 6.34 | 24.92 | 15.37 | 50.51 | 23.54 | |
| Vanilla LLMCandidate Set Size (N)=202026.01 | 2.54 | 14.61 | 8.31 | 51.28 | 20.1 |