Recommendation on Toys (HR, NDCG, Repeat, OOD)
7.9Hit Rate @ 10 (HR@10)LC-Rec
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LC-RecMethod Type=LLMs (item tokenizer)2025.05 | 7.9 | 5.84 | 6.52 | 5.4 | 0 | 0 | |
| RecLM-tokenMethod Type=LLMs (ours)2025.05 | 7.14 | 6.51 | 6.86 | 6.43 | 0.86 | 0 | |
| RecLM-cgenMethod Type=LLMs (ours)2025.05 | 6.57 | 5.08 | 5.43 | 4.7 | 0 | 0 | |
| RecLM-retMethod Type=LLMs (ours)2025.05 | 5.96 | 4.37 | 4.99 | 4.05 | 0 | 0 | |
| SASRecMethod Type=Traditional Recommenders2025.05 | 5.89 | 4.84 | 5.29 | 4.64 | — | — | |
| LETTERMethod Type=LLMs (item tokenizer)2025.05 | 5.15 | 3.94 | 4.2 | 3.97 | 0 | 0 | |
| IDGenRecMethod Type=LLMs (item tokenizer)2025.05 | 4.98 | 4.02 | 4.18 | 3.76 | 0 | 0 | |
| CtrlRecMethod Type=LLMs (finetuned)2025.05 | 4.73 | 3.78 | 4.26 | 3.63 | 5.91 | 7.8 | |
| PALRMethod Type=LLMs (finetuned)2025.05 | 4.38 | 3.69 | 4.07 | 3.59 | 29.5 | 37 | |
| BIGRecMethod Type=LLMs (finetuned)2025.05 | 4.05 | 2.72 | 3.11 | 2.42 | 0 | 0 | |
| GRU4RecMethod Type=Traditional Recommenders2025.05 | 3.89 | 2.28 | 2.76 | 1.92 | — | — | |
| SETRecMethod Type=LLMs (item tokenizer)2025.05 | 3.71 | 3.01 | 3.27 | 2.87 | 0 | 0 | |
| Llama3-cgenMethod Type=LLMs (frozen)2025.05 | 3.54 | 1.53 | 1.91 | 1.04 | 0 | 4.16 | |
| Llama3Method Type=LLMs (frozen)2025.05 | 0.39 | 0.2 | 0.19 | 0.13 | 2.1 | 90.99 | |
| GPT-4oMethod Type=LLMs (frozen)2025.05 | 0.31 | 0.13 | 0.21 | 0.1 | 0.31 | 89.57 |