Recommendation on Movielens (R@5, R@10, N@5, N@10, M@5, M@10)
8.365Recall@5SASRec
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SASRecUser Simulator=SFT+DPO (USERMIRRORER)2025.08 | 8.365 | 13.999 | 5.027 | 6.852 | 3.938 | 4.694 | |
| NARMUser Simulator=SFT+DPO (USERMIRRORER)2025.08 | 8.175 | 14.757 | 4.772 | 6.895 | 3.672 | 4.545 | |
| SASRecUser Simulator=Base LLM2025.08 | 8.024 | 13.961 | 4.8 | 6.689 | 3.748 | 4.51 | |
| NARMUser Simulator=Base LLM2025.08 | 8.024 | 14.662 | 4.761 | 6.891 | 3.7 | 4.569 | |
| SASRecUser Simulator=Backbone2025.08 | 7.303 | 12.785 | 4.279 | 6.038 | 3.297 | 4.015 | |
| NARMUser Simulator=Backbone2025.08 | 6.791 | 12.747 | 3.973 | 5.879 | 3.059 | 3.834 | |
| DiffRecUser Simulator=SFT+DPO (USERMIRRORER)2025.08 | 6.449 | 10.338 | 4.544 | 5.793 | 3.924 | 4.434 | |
| MultiDAEStage=SFT+DPO2025.08 | 6.392 | 10.015 | 4.244 | 5.41 | 3.543 | 4.021 | |
| NGCFStage=SFT+DPO2025.08 | 6.108 | 9.826 | 4.024 | 5.213 | 3.344 | 3.827 | |
| LightGCNUser Simulator=SFT+DPO (USERMIRRORER)2025.08 | 6.089 | 9.996 | 3.845 | 5.098 | 3.112 | 3.623 | |
| DiffRecUser Simulator=Base LLM2025.08 | 6.051 | 9.674 | 4.026 | 5.198 | 3.366 | 3.851 | |
| SGLStage=SFT+DPO2025.08 | 5.728 | 9.674 | 3.709 | 4.975 | 3.05 | 3.566 | |
| MultiDAEStage=Base LLM2025.08 | 5.672 | 9.503 | 3.643 | 4.867 | 2.982 | 3.478 | |
| NGCFStage=Base LLM2025.08 | 5.634 | 9.427 | 3.596 | 4.802 | 2.933 | 3.419 | |
| LightGCNUser Simulator=Base LLM2025.08 | 5.596 | 9.465 | 3.513 | 4.751 | 2.834 | 3.337 | |
| BPRStage=SFT+DPO2025.08 | 5.52 | 9.256 | 3.531 | 4.727 | 2.883 | 3.37 | |
| SGLStage=Base LLM2025.08 | 5.425 | 9.048 | 3.426 | 4.59 | 2.773 | 3.249 | |
| NGCFStage=Backbone2025.08 | 5.292 | 8.763 | 3.487 | 4.584 | 2.9 | 3.339 | |
| SimpleXStage=SFT+DPO2025.08 | 5.292 | 8.801 | 3.307 | 4.431 | 2.655 | 3.113 | |
| BPRStage=Base LLM2025.08 | 5.235 | 8.725 | 3.249 | 4.371 | 2.602 | 3.062 | |
| DiffRecUser Simulator=Backbone2025.08 | 5.197 | 9.219 | 3.313 | 4.613 | 2.7 | 3.236 | |
| LightGCNUser Simulator=Backbone2025.08 | 5.178 | 8.782 | 3.23 | 4.386 | 2.596 | 3.069 | |
| MultiDAEStage=Backbone2025.08 | 5.046 | 8.953 | 3.314 | 4.562 | 2.75 | 3.255 | |
| SimpleXStage=Base LLM2025.08 | 4.989 | 8.062 | 3.081 | 4.065 | 2.463 | 2.863 | |
| BPRStage=Backbone2025.08 | 4.97 | 8.403 | 3.138 | 4.239 | 2.541 | 2.99 | |
| NeuMFStage=SFT+DPO2025.08 | 4.894 | 8.043 | 3.111 | 4.116 | 2.53 | 2.938 | |
| NeuMFStage=Base LLM2025.08 | 4.818 | 8.441 | 3.061 | 4.213 | 2.482 | 2.947 | |
| SGLStage=Backbone2025.08 | 4.78 | 8.384 | 2.981 | 4.139 | 2.397 | 2.87 | |
| SimpleXStage=Backbone2025.08 | 4.742 | 8.08 | 2.908 | 3.973 | 2.308 | 2.739 | |
| NeuMFStage=Backbone2025.08 | 3.699 | 7.398 | 2.297 | 3.472 | 1.839 | 2.312 |