Recommendation on Amazon Beauty (test)
23.51HR@5ReasonRec
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ReasonRecTask=Direct Recommendation2026.06 | 23.51 | — | — | — | — | 16.55 | — | — | |
| UniMPTask=Direct Recommendation2026.06 | 18.25 | — | — | — | — | 12.2 | — | — | |
| VIP5Task=Direct Recommendation2026.06 | 17.39 | — | — | — | — | 11.13 | — | — | |
| P5Task=Direct Recommendation2026.06 | 16.81 | — | — | — | — | 11.23 | — | — | |
| Majority VoteTask=Direct Recommendation2026.06 | 16.12 | — | — | — | — | 10.43 | — | — | |
| Light-GCNTask=Direct Recommendation2026.06 | 15.01 | — | — | — | — | 9.04 | — | — | |
| BPR-MFTask=Direct Recommendation2026.06 | 14.26 | — | — | — | — | 9.13 | — | — | |
| BPR-MLPTask=Direct Recommendation2026.06 | 13.81 | — | — | — | — | 8.91 | — | — | |
| DeepInterestGRBackbone=Qwen2.5-7B-Instruct, Beam size=202026.02 | 6.78 | 10.32 | 4.36 | 5.58 | — | — | — | — | |
| MiniOneRecMethod Category=Generative Recommendation Models, Backbone=Qwen2.5-7B-Instruct, Beam size=202026.02 | 6.12 | 9.45 | 3.89 | 5.02 | — | — | — | — | |
| S-DPOMethod Category=LLM-based Models2026.02 | 5.89 | 9.18 | 3.72 | 4.83 | — | — | — | — | |
| HSTUMethod Category=Generative Recommendation Models, Beam size=202026.02 | 5.56 | 8.67 | 3.51 | 4.56 | — | — | — | — | |
| BIGRecMethod Category=LLM-based Models2026.02 | 5.34 | 8.39 | 3.36 | 4.39 | — | — | — | — | |
| LC-RecMethod Category=Generative Recommendation Models, Beam size=202026.02 | 5.23 | 8.21 | 3.28 | 4.28 | — | — | — | — | |
| D3Method Category=LLM-based Models2026.02 | 4.98 | 7.85 | 3.12 | 4.09 | — | — | — | — | |
| TIGERMethod Category=Generative Recommendation Models, Beam size=202026.02 | 4.87 | 7.63 | 3.02 | 3.95 | — | — | — | — | |
| S3-RecMethod Category=Transformer-based Models2026.02 | 4.45 | 7.18 | 2.71 | 3.61 | — | — | — | — | |
| FDSAMethod Category=Transformer-based Models2026.02 | 4.32 | 6.98 | 2.63 | 3.51 | — | — | — | — | |
| BERT4RecMethod Category=Transformer-based Models2026.02 | 4.21 | 6.82 | 2.56 | 3.42 | — | — | — | — | |
| SASRecMethod Category=Transformer-based Models2026.02 | 3.98 | 6.45 | 2.41 | 3.23 | — | — | — | — | |
| HGNMethod Category=Traditional Sequential Models2026.02 | 3.35 | 5.49 | 2.01 | 2.71 | — | — | — | — | |
| GRU4RecMethod Category=Traditional Sequential Models2026.02 | 3.12 | 5.18 | 1.89 | 2.56 | — | — | — | — | |
| CaserMethod Category=Traditional Sequential Models2026.02 | 2.87 | 4.83 | 1.71 | 2.34 | — | — | — | — | |
| CobraModel Type=Semantic ID-based Generative Recommendation2026.04 | — | — | — | — | 5.27 | 3.34 | 9.09 | 6.25 | |
| HeterRecModel Type=Item ID-based Discriminative Recommendation2026.04 | — | — | — | — | 5.21 | 3.32 | 8.94 | 6.16 | |
| LWGRBackbone=Qwen3-4B2026.04 | — | — | — | — | 5.95 | 3.76 | 10.26 | 7.01 | |
| PinnerFormerModel Type=Item ID-based Discriminative Recommendation2026.04 | — | — | — | — | 5.29 | 3.35 | 9.02 | 6.19 | |
| SASRecModel Type=Item ID-based Discriminative Recommendation2026.04 | — | — | — | — | 5.12 | 3.26 | 8.61 | 5.89 | |
| TIGERModel Type=Semantic ID-based Generative Recommendation2026.04 | — | — | — | — | 5.34 | 3.41 | 9.12 | 6.3 | |
| TIGER + KARModel Type=Semantic ID-based Generative Recommendation2026.04 | — | — | — | — | 5.43 | 3.47 | 9.27 | 6.34 | |
| TIGER + SeRALMModel Type=Semantic ID-based Generative Recommendation2026.04 | — | — | — | — | 5.39 | 3.44 | 9.31 | 6.42 | |
| VQ-RecModel Type=Item ID-based Discriminative Recommendation2026.04 | — | — | — | — | 5.13 | 3.22 | 8.83 | 6.08 |