Recommendation on Amazon Instruments (test)
0.0953HR@5SimGR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SimGRBackbone=Qwen3-4B2026.02 | 0.0953 | 0.0641 | 0.1156 | 0.0802 | 0.0868 | |
| TIGER2026.02 | 0.0863 | 0.0608 | 0.1064 | 0.0738 | 0.0803 | |
| LC-RecBackbone=Qwen3-4B2026.02 | 0.0844 | 0.0601 | 0.1029 | 0.0726 | 0.0784 | |
| P5-CID2026.02 | 0.0827 | 0.0587 | 0.1016 | 0.0546 | 0.0625 | |
| SASRec2026.02 | 0.0808 | 0.0209 | 0.1065 | 0.0526 | 0.0609 | |
| S3-Rec2026.02 | 0.0808 | 0.0262 | 0.1079 | 0.0565 | 0.0643 | |
| RPG2026.02 | 0.0756 | 0.0562 | 0.0902 | 0.0619 | 0.0666 | |
| GRU4Rec2026.02 | 0.0754 | 0.0426 | 0.0966 | 0.0596 | 0.0665 | |
| BERT4Rec2026.02 | 0.0633 | 0.0258 | 0.0803 | 0.0454 | 0.0508 | |
| DeepInterestGRBackbone=Qwen2.5-7B-Instruct, Beam size=202026.02 | 0.0623 | — | 0.0972 | 0.0394 | 0.0513 | |
| Caser2026.02 | 0.0583 | 0.0182 | 0.075 | 0.0392 | 0.0446 | |
| HGN2026.02 | 0.0583 | 0.0537 | 0.075 | 0.0392 | 0.0446 | |
| MiniOneRecMethod Category=Generative Recommendation Models, Backbone=Qwen2.5-7B-Instruct, Beam size=202026.02 | 0.0556 | — | 0.0878 | 0.0347 | 0.0455 | |
| S-DPOMethod Category=LLM-based Models2026.02 | 0.0537 | — | 0.0852 | 0.0334 | 0.044 | |
| HSTUMethod Category=Generative Recommendation Models, Beam size=202026.02 | 0.0508 | — | 0.0809 | 0.0315 | 0.0415 | |
| BIGRecMethod Category=LLM-based Models2026.02 | 0.0487 | — | 0.0779 | 0.0302 | 0.0399 | |
| LC-RecMethod Category=Generative Recommendation Models, Beam size=202026.02 | 0.0478 | — | 0.0765 | 0.0295 | 0.039 | |
| D3Method Category=LLM-based Models2026.02 | 0.0456 | — | 0.0732 | 0.0282 | 0.0374 | |
| TIGERMethod Category=Generative Recommendation Models, Beam size=202026.02 | 0.0445 | — | 0.0712 | 0.0273 | 0.0362 | |
| S3-RecMethod Category=Transformer-based Models2026.02 | 0.0407 | — | 0.0656 | 0.0247 | 0.033 | |
| FDSAMethod Category=Transformer-based Models2026.02 | 0.0394 | — | 0.0636 | 0.0239 | 0.032 | |
| BERT4RecMethod Category=Transformer-based Models2026.02 | 0.0385 | — | 0.0621 | 0.0233 | 0.0312 | |
| SASRecMethod Category=Transformer-based Models2026.02 | 0.0361 | — | 0.0583 | 0.0218 | 0.0292 | |
| HGNMethod Category=Traditional Sequential Models2026.02 | 0.0302 | — | 0.0495 | 0.0183 | 0.0246 | |
| GRU4RecMethod Category=Traditional Sequential Models2026.02 | 0.0285 | — | 0.0467 | 0.0172 | 0.0231 | |
| CaserMethod Category=Traditional Sequential Models2026.02 | 0.0261 | — | 0.0432 | 0.0156 | 0.0212 |