Generative Recommendation on ML OOD 10M
61Hit Rate @10CausalDPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CausalDPO2026.03 | 61 | 35 | 1.02 | 45 | |
| SDPO2026.03 | 55 | 30 | 0.87 | 38 | |
| SPRec2026.03 | 55 | 30 | 0.71 | 36 | |
| BIGRec2026.03 | 53 | 29 | 0.76 | 35 | |
| RosePO2026.03 | 51 | 26 | 0.83 | 33 | |
| SASRec2026.03 | 50 | 2 | 0.84 | 30 | |
| RW2026.03 | 50 | 28 | 0.74 | 30 | |
| D32026.03 | 50 | 25 | 0.8 | 34 | |
| DMPO2026.03 | 44 | 20 | 0.81 | 29 | |
| CausalDPObase model=Llama-3.1-8B, epochs=3, negative sampling=random sampling, distribution=IID2026.03 | 0.79 | 0.48 | 1.12 | 0.51 | |
| RWbase model=Llama-3.1-8B, epochs=3, distribution=IID2026.03 | 0.77 | 0.45 | 1.03 | 0.45 | |
| D3base model=Llama-3.1-8B, epochs=3, distribution=IID2026.03 | 0.72 | 0.41 | 0.99 | 0.4 | |
| BIGRecbase model=Llama-3.1-8B, epochs=3, distribution=IID2026.03 | 0.66 | 0.31 | 1 | 0.4 | |
| DMPObase model=Llama-3.1-8B, epochs=3, negative samples=single, distribution=IID2026.03 | 0.63 | 0.33 | 0.97 | 0.42 | |
| SDPObase model=Llama-3.1-8B, epochs=3, negative samples=single, distribution=IID2026.03 | 0.6 | 0.36 | 0.94 | 0.45 | |
| SPRecbase model=Llama-3.1-8B, epochs=3, negative samples=single-iteration SFT output, distribution=IID2026.03 | 0.6 | 0.31 | 0.95 | 0.41 | |
| RosePObase model=Llama-3.1-8B, epochs=3, negative samples=single, distribution=IID2026.03 | 0.58 | 0.29 | 0.89 | 0.38 | |
| SASRecembedding dimension=32, dropout rate=0.1, distribution=IID2026.03 | 0.47 | 0.17 | 0.75 | 0.27 |