Sequential Recommendation on Steam (test)
63.06NDCG@10SASRec
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SASRecblocks=2, latent dimension d=502018.08 | 63.06 | 87.29 | — | — | — | — | — | — | — | |
| GRU4Rec*2018.08 | 55.95 | 80.18 | — | — | — | — | — | — | — | |
| Caser2018.08 | 53.81 | 78.74 | — | — | — | — | — | — | — | |
| FMC2018.08 | 51.93 | 77.31 | — | — | — | — | — | — | — | |
| FPMC2018.08 | 50.11 | 77.1 | — | — | — | — | — | — | — | |
| TransRec2018.08 | 48.52 | 76.24 | — | — | — | — | — | — | — | |
| PopRec2018.08 | 45.35 | 71.72 | — | — | — | — | — | — | — | |
| BPR2018.08 | 44.36 | 70.61 | — | — | — | — | — | — | — | |
| GRU4Rec2018.08 | 26.91 | 41.9 | — | — | — | — | — | — | — | |
| HyenaRec2026.03 | 7.238 | — | — | — | 8.925 | 13.513 | 20.222 | — | — | |
| HSTU2026.03 | 7.094 | — | — | — | 8.736 | 13.239 | 19.764 | — | — | |
| LRURec2026.03 | 6.934 | — | — | — | 8.508 | 12.831 | 19.082 | — | — | |
| EulerFormer2026.03 | 6.825 | — | — | — | 7.916 | 12.037 | 18.416 | — | — | |
| SASRec2026.03 | 6.759 | — | — | — | 8.298 | 12.597 | 18.716 | — | — | |
| GRU4Rec2026.03 | 6.512 | — | — | — | 8.05 | 12.204 | 18.319 | — | — | |
| SASRecDescription=Teacher recommender model2024.03 | 6.48 | 11.21 | 7.78 | 5.38 | — | — | — | — | — | |
| NARM2026.03 | 6.48 | — | — | — | 8 | 12.166 | 18.199 | — | — | |
| BERT4Rec2026.03 | 6.433 | — | — | — | 8.117 | 12.188 | 18.245 | — | — | |
| RecLM-gen (v2)Training Stage=SL, Instructions=All instructions (I0,1,2,3,4)2024.03 | 5.83 | 10.36 | 7.17 | 4.79 | — | — | — | — | — | |
| RecLM-gen (v3)Training Stage=RL, Base Model=v2, Reward=Without item-level reward2024.03 | 5.57 | 10.14 | 6.95 | 4.54 | — | — | — | — | — | |
| RecLM-gen (full)Training Stage=SL + RL, Description=Complete version2024.03 | 5.51 | 10.01 | 6.88 | 4.49 | — | — | — | — | — | |
| RecLM-gen (v1)Training Stage=SL, Instructions=Sequential recommendation instructions (I0)2024.03 | 5.35 | 9.3 | 6.66 | 4.51 | — | — | — | — | — | |
| PALRDescription=Fine-tuned benchmark2024.03 | 3.2 | 4.08 | 3.73 | 3.08 | — | — | — | — | — | |
| InstructRecDescription=Fine-tuned benchmark2024.03 | 1.13 | 2.2 | 1.22 | 0.82 | — | — | — | — | — | |
| GPT-3.5Description=General LLM2024.03 | 0.79 | 1.6 | 0.9 | 0.55 | — | — | — | — | — | |
| Llama2-7bDescription=General LLM2024.03 | 0.28 | 0.52 | 0.16 | 0.12 | — | — | — | — | — | |
| CaserModel Type=Trad., Backbone=-2025.06 | — | — | — | — | — | — | — | 43.94 | 100 | |
| DPOModel Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 33.4 | 99.8 | |
| DPOModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 24.57 | 99.6 | |
| GRU4RecModel Type=Trad., Backbone=-2025.06 | — | — | — | — | — | — | — | 45.84 | 100 | |
| LLaMA3Model Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 8.52 | 86.72 | |
| QwenModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 14.77 | 62.93 | |
| RecPOModel Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 46.72 | 99.85 | |
| RecPOModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 41.43 | 99.12 | |
| S-DPOModel Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 35.88 | 99.9 | |
| S-DPOModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 30.62 | 99.7 | |
| SASRecModel Type=Trad., Backbone=-2025.06 | — | — | — | — | — | — | — | 45.87 | 100 | |
| SFTModel Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 31.22 | 99.9 | |
| SFTModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 20.81 | 99.5 | |
| SimPOModel Type=LLM, Backbone=LLaMA3-8B2025.06 | — | — | — | — | — | — | — | 34.01 | 97.66 | |
| SimPOModel Type=LLM, Backbone=Qwen-7B2025.06 | — | — | — | — | — | — | — | 37.06 | 99.4 |