Recommendation on MovieLens 10M (test)
9.35Recall@10openP5 (+RAIE)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| openP5 (+RAIE)Backbone=openP5, Variant=+RAIE2026.02 | 9.35 | 4.86 | — | — | — | |
| openP5 (+LoRA+LwF)Backbone=openP5, Variant=+LoRA+LwF2026.02 | 8.9 | 4.77 | — | — | — | |
| openP5 (+LoRA+Replay)Backbone=openP5, Variant=+LoRA+Replay2026.02 | 8.87 | 4.74 | — | — | — | |
| openP5 (+LoRA)Backbone=openP5, Variant=+LoRA2026.02 | 8.77 | 4.7 | — | — | — | |
| BERT4Rec (+RAIE)Backbone=BERT4Rec, Variant=+RAIE2026.02 | 8.7 | 4.53 | — | — | — | |
| openP5 (+E-BPR)Backbone=openP5, Variant=+E-BPR2026.02 | 8.67 | 4.63 | — | — | — | |
| openP5 (+MoLE)Backbone=openP5, Variant=+MoLE2026.02 | 5.79 | 2.76 | — | — | — | |
| BERT4Rec (+LoRA+LwF)Backbone=BERT4Rec, Variant=+LoRA+LwF2026.02 | 5.73 | 2.88 | — | — | — | |
| openP5 (+LSAT)Backbone=openP5, Variant=+LSAT2026.02 | 5.72 | 2.93 | — | — | — | |
| BERT4Rec (+LoRA)Backbone=BERT4Rec, Variant=+LoRA2026.02 | 5.69 | 2.86 | — | — | — | |
| BERT4Rec (+LoRA+Replay)Backbone=BERT4Rec, Variant=+LoRA+Replay2026.02 | 5.63 | 2.82 | — | — | — | |
| BERT4Rec (+LSAT)Backbone=BERT4Rec, Variant=+LSAT2026.02 | 5.61 | 2.79 | — | — | — | |
| TiSASRec (+RAIE)Backbone=TiSASRec, Variant=+RAIE2026.02 | 4.83 | 2.31 | — | — | — | |
| BERT4Rec (+MoLE)Backbone=BERT4Rec, Variant=+MoLE2026.02 | 4.67 | 2.29 | — | — | — | |
| TiSASRec (+LoRA+Replay)Backbone=TiSASRec, Variant=+LoRA+Replay2026.02 | 4.67 | 2.25 | — | — | — | |
| TiSASRec (+LoRA+LwF)Backbone=TiSASRec, Variant=+LoRA+LwF2026.02 | 4.67 | 2.25 | — | — | — | |
| TiSASRec (+MoLE)Backbone=TiSASRec, Variant=+MoLE2026.02 | 4.67 | 2.27 | — | — | — | |
| SASRec (+RAIE)Backbone=SASRec, Variant=+RAIE2026.02 | 4.49 | 2.09 | — | — | — | |
| TiSASRec (+LoRA)Backbone=TiSASRec, Variant=+LoRA2026.02 | 4.49 | 2.2 | — | — | — | |
| TiSASRec (+E-BPR)Backbone=TiSASRec, Variant=+E-BPR2026.02 | 4.43 | 2.18 | — | — | — | |
| BERT4Rec (Base)Backbone=BERT4Rec, Variant=Base2026.02 | 4.4 | 2.16 | — | — | — | |
| BERT4Rec (+E-BPR)Backbone=BERT4Rec, Variant=+E-BPR2026.02 | 4.4 | 2.15 | — | — | — | |
| SASRec (+LoRA+LwF)Backbone=SASRec, Variant=+LoRA+LwF2026.02 | 3.74 | 1.76 | — | — | — | |
| SASRec (+LoRA)Backbone=SASRec, Variant=+LoRA2026.02 | 3.66 | 1.72 | — | — | — | |
| TiSASRec (+LSAT)Backbone=TiSASRec, Variant=+LSAT2026.02 | 3.59 | 1.76 | — | — | — | |
| openP5 (Base)Backbone=openP5, Variant=Base2026.02 | 3.56 | 1.96 | — | — | — | |
| SASRec (+LSAT)Backbone=SASRec, Variant=+LSAT2026.02 | 3.48 | 1.62 | — | — | — | |
| SASRec (+E-BPR)Backbone=SASRec, Variant=+E-BPR2026.02 | 3.44 | 1.66 | — | — | — | |
| TiSASRec (Base)Backbone=TiSASRec, Variant=Base2026.02 | 3.42 | 1.67 | — | — | — | |
| SASRec (+LoRA+Replay)Backbone=SASRec, Variant=+LoRA+Replay2026.02 | 3.22 | 1.5 | — | — | — | |
| SASRec (Base)Backbone=SASRec, Variant=Base2026.02 | 2.34 | 1.08 | — | — | — | |
| SASRec (+MoLE)Backbone=SASRec, Variant=+MoLE2026.02 | 2.34 | 1.07 | — | — | — | |
| BigRecMode=SFT-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 6.57 | 8.84 | 9.62 | |
| BigRecMode=SFT-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 7.47 | 10.69 | 11.8 | |
| D3Mode=SFT-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 6.12 | 8.81 | 9.48 | |
| D3Mode=SFT-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 7.1 | 10.38 | 11.59 | |
| DMPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 4.61 | 7.01 | 7.58 | |
| DMPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 5.62 | 8.75 | 9.38 | |
| LiPO (BT)Mode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 6.22 | 9.8 | 11 | |
| LiPO (BT)Mode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 6.72 | 10.46 | 11.85 | |
| Mult-DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 6.5 | 10.01 | 11.03 | |
| Mult-DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 7.51 | 11.55 | 13 | |
| Qwen2.5-0.5B-InstructMode=zero-shot, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 1.36 | 1.56 | 1.56 | |
| Qwen2.5-3B-InstructMode=zero-shot, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 2.32 | 3.4 | 3.59 | |
| S-DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 5.92 | 9.2 | 10.49 | |
| S-DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 6.31 | 9.89 | 11.22 | |
| Vanilla DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | — | — | 4.26 | 7.1 | 8.34 | |
| Vanilla DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | — | — | 5.59 | 8.06 | 9.03 |