Sequential Recommendation on Amazon Toys and Games (test)
4.89NDCG@5MHL
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MHLIdentification Method=Semantic ID-based, Embeddings=Sentence-T5-base2025.09 | 4.89 | — | — | — | — | 5.64 | 6.72 | 9.03 | |
| AsymRecID Representation Type=Semantic ID-based2026.05 | 4.5 | — | — | — | — | 5.51 | 6.58 | 9.71 | |
| RoTE-RPGCategory=Generative2026.04 | 4.48 | — | — | 6.24 | 8.52 | 5.21 | — | — | |
| PAUSERECbackbone=Qwen3-1.7B, number of pauses=52026.06 | 4.34 | — | — | 6.15 | 8.38 | 5.09 | — | — | |
| OneRec-Thinkbackbone=Qwen3-1.7B2026.06 | 4.12 | — | — | 5.79 | 7.97 | 4.82 | — | — | |
| Next-item SFTbackbone=Qwen3-1.7B2026.06 | 4.02 | — | — | 5.65 | 7.81 | 4.71 | — | — | |
| RPGID Representation Type=Semantic ID-based2026.05 | 4.01 | — | — | — | — | 4.9 | 5.92 | 8.69 | |
| RPGIdentification Method=Semantic ID-based, Embeddings=Sentence-T5-base2025.09 | 3.86 | — | — | — | — | 4.6 | 5.5 | 7.78 | |
| RPGCategory=Generative2026.04 | 3.73 | — | — | 5.31 | 7.59 | 4.46 | — | — | |
| TIGERCategory=Generative2026.04 | 3.71 | — | — | 5.21 | 7.12 | 4.32 | — | — | |
| TIGERIdentification Method=Semantic ID-based2025.09 | 3.71 | — | — | — | — | 4.32 | 5.21 | 7.12 | |
| TIGERID Representation Type=Semantic ID-based2026.05 | 3.71 | — | — | — | — | 4.32 | 5.21 | 7.12 | |
| VQ-RecIdentification Method=Semantic ID-based2025.09 | 3.46 | — | — | — | — | 4.23 | 4.97 | 7.37 | |
| VQ-RecID Representation Type=Semantic ID-based2026.05 | 3.46 | — | — | — | — | 4.23 | 4.97 | 7.37 | |
| RoTE-SASRecCategory=Traditional2026.04 | 3.45 | — | — | 5.12 | 7.47 | 4.2 | — | — | |
| SASRecCategory=Traditional2026.04 | 3.1 | — | — | 4.66 | 6.88 | 3.75 | — | — | |
| SASRecIdentification Method=Item ID-based2025.09 | 3.06 | — | — | — | — | 3.74 | 4.63 | 6.75 | |
| SASRecID Representation Type=Item ID-based2026.05 | 3.06 | — | — | — | — | 3.74 | 4.63 | 6.75 | |
| SASRec2026.06 | 3 | — | — | 4.48 | 6.26 | 3.58 | — | — | |
| ReaRec2026.06 | 2.98 | — | — | 5.23 | 7.64 | 3.76 | — | — | |
| S3-RecIdentification Method=Item ID-based2025.09 | 2.94 | — | — | — | — | 3.76 | 4.43 | 7 | |
| S3-RecID Representation Type=Item ID-based2026.05 | 2.94 | — | — | — | — | 3.76 | 4.43 | 7 | |
| HSTUCategory=Generative2026.04 | 2.81 | — | — | 4.33 | 6.69 | 3.57 | — | — | |
| HSTUIdentification Method=Semantic ID-based2025.09 | 2.81 | — | — | — | — | 3.57 | 4.33 | 6.69 | |
| HSTUID Representation Type=Semantic ID-based2026.05 | 2.81 | — | — | — | — | 3.57 | 4.33 | 6.69 | |
| VQ-RecCategory=Generative2026.04 | 2.56 | — | — | 3.73 | 4.84 | 3.23 | — | — | |
| HSTU2026.06 | 2.45 | — | — | 3.66 | 5.66 | 3.09 | — | — | |
| GRU4Rec2026.06 | 2.28 | — | — | 3.3 | 4.9 | 2.79 | — | — | |
| HGNIdentification Method=Item ID-based2025.09 | 2.21 | — | — | — | — | 2.77 | 3.21 | 4.97 | |
| HGNID Representation Type=Item ID-based2026.05 | 2.21 | — | — | — | — | 2.77 | 3.21 | 4.97 | |
| TIGER2026.06 | 2.09 | — | — | 3.37 | 5.47 | 2.76 | — | — | |
| HGN2026.06 | 1.92 | — | — | 3.26 | 5.17 | 2.54 | — | — | |
| RecJPQIdentification Method=Semantic ID-based2025.09 | 1.82 | — | — | — | — | 2.31 | 3.31 | 4.84 | |
| RecJPQID Representation Type=Semantic ID-based2026.05 | 1.82 | — | — | — | — | 2.31 | 3.31 | 4.84 | |
| FDSAIdentification Method=Item ID-based2025.09 | 1.4 | — | — | — | — | 1.89 | 2.28 | 3.81 | |
| FDSAID Representation Type=Item ID-based2026.05 | 1.4 | — | — | — | — | 1.89 | 2.28 | 3.81 | |
| BERT4Rec2026.06 | 1.31 | — | — | 2.15 | 3.32 | 1.68 | — | — | |
| CaserCategory=Traditional2026.04 | 1.07 | — | — | 1.66 | 2.7 | 1.41 | — | — | |
| CaserIdentification Method=Item ID-based2025.09 | 1.07 | — | — | — | — | 1.41 | 1.66 | 2.7 | |
| CaserID Representation Type=Item ID-based2026.05 | 1.07 | — | — | — | — | 1.41 | 1.66 | 2.7 | |
| BERT4RecCategory=Traditional2026.04 | 0.71 | — | — | 1.16 | 2.03 | 0.99 | — | — | |
| BERT4RecIdentification Method=Item ID-based2025.09 | 0.71 | — | — | — | — | 0.99 | 1.16 | 2.03 | |
| BERT4RecID Representation Type=Item ID-based2026.05 | 0.71 | — | — | — | — | 0.99 | 1.16 | 2.03 | |
| GRU4RecCategory=Traditional2026.04 | 0.59 | — | — | 0.97 | 1.76 | 0.84 | — | — | |
| GRU4RecIdentification Method=Item ID-based2025.09 | 0.59 | — | — | — | — | 0.84 | 0.97 | 1.76 | |
| GRU4RecID Representation Type=Item ID-based2026.05 | 0.59 | — | — | — | — | 0.84 | 0.97 | 1.76 | |
| BERT4Rec2025.06 | — | 0.0071 | 0.0099 | 1.16 | 2.03 | — | — | — | |
| BERT4RecID representation type=Item ID-based2026.05 | — | 0.0174 | 0.0249 | — | — | — | 2.46 | 2.97 | |
| Caser2025.06 | — | 0.0107 | 0.0141 | 1.66 | 2.7 | — | — | — | |
| CoVEcompression rate=22025.06 | — | 0.0509 | 0.0595 | 7.19 | 9.86 | — | — | — | |
| ETEGRecID representation type=Semantic ID-based2026.05 | — | 0.0295 | 0.0367 | — | — | — | 4.23 | 6.01 | |
| FDSA2025.06 | — | 0.014 | 0.0189 | 2.28 | 3.81 | — | — | — | |
| FMLPID representation type=Item ID-based2026.05 | — | 0.0239 | 0.0298 | — | — | — | 4.48 | 6.31 | |
| GRU4Rec2025.06 | — | 0.0059 | 0.0084 | 0.97 | 1.76 | — | — | — | |
| GRU4RecID representation type=Item ID-based2026.05 | — | 0.0143 | 0.018 | — | — | — | 2.13 | 2.97 | |
| HGN2025.06 | — | 0.0221 | 0.0277 | 3.21 | 4.97 | — | — | — | |
| HGNID representation type=Item ID-based2026.05 | — | 0.0143 | 0.017 | — | — | — | 2.24 | 3.13 | |
| HSTUID representation type=Item ID-based2026.05 | — | 0.026 | 0.032 | — | — | — | 3.7 | 5.59 | |
| LC-RecID representation type=Semantic ID-based2026.05 | — | 0.0294 | 0.0385 | — | — | — | 4.35 | 6.38 | |
| LETTER-LCRecID representation type=Semantic ID-based2026.05 | — | 0.0301 | 0.0398 | — | — | — | 4.47 | 6.52 | |
| LETTER-TIGERID representation type=Semantic ID-based2026.05 | — | 0.0288 | 0.0373 | — | — | — | 4.18 | 6.25 | |
| P52025.06 | — | 0.005 | 0.0066 | 0.7 | 1.21 | — | — | — | |
| S3-Rec2025.06 | — | 0.0294 | 0.0376 | 4.43 | 7 | — | — | — | |
| S3RecID representation type=Item ID-based2026.05 | — | 0.0283 | 0.0405 | — | — | — | 4.71 | 7.85 | |
| SASRec2025.06 | — | 0.0306 | 0.0374 | 4.63 | 6.75 | — | — | — | |
| SASRecID representation type=Item ID-based2026.05 | — | 0.0246 | 0.0304 | — | — | — | 3.56 | 5.4 | |
| TIGER2025.06 | — | 0.0371 | 0.0432 | 5.21 | 7.12 | — | — | — | |
| TIGERID representation type=Semantic ID-based2026.05 | — | 0.0273 | 0.0331 | — | — | — | 4.02 | 5.83 | |
| VarLenRec-LCRecID representation type=Semantic ID-based2026.05 | — | 0.0317 | 0.0454 | — | — | — | 5.28 | 8.79 | |
| VarLenRec-TIGERID representation type=Semantic ID-based2026.05 | — | 0.0301 | 0.0431 | — | — | — | 5.02 | 8.35 |