Sequential Recommendation on MovieLens (Recall/NDCG @1, @3, @5)
27.7Recall@1SFT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SFTBackbone=Qwen3.5-2B2026.05 | 27.7 | 34.7 | 41 | 27.7 | 31.6 | 34.2 | |
| F-GRPOBackbone=Qwen3-4B2026.05 | 26.9 | 53.6 | 66.6 | 26.9 | 42.3 | 47.6 | |
| GRPOBackbone=Qwen3.5-2B2026.05 | 24.4 | 50.7 | 56.4 | 24.4 | 39.6 | 42.1 | |
| GRPOBackbone=Qwen3-4B2026.05 | 23.9 | 44.4 | 57.7 | 23.9 | 35.8 | 41.2 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=full2026.05 | 23.6 | 31.6 | 40.6 | 23.6 | 28.2 | 31.9 | |
| GRU4Rec2026.05 | 21.8 | 46.8 | 60.2 | 21.8 | 36.1 | 41.6 | |
| SFTBackbone=Qwen3-4B2026.05 | 21.5 | 29.3 | 36.5 | 21.5 | 25.8 | 28.8 | |
| F-GRPOBackbone=Qwen3.5-2B2026.05 | 21.5 | 45.8 | 61.1 | 21.5 | 35.5 | 41.8 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=full2026.05 | 19.7 | 27.8 | 35.5 | 19.7 | 24.3 | 27.5 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=rank. only2026.05 | 16.5 | 28 | 37 | 16.5 | 23 | 26.8 | |
| Popularity2026.05 | 14.4 | 36.3 | 55.1 | 14.4 | 26.9 | 34.6 | |
| UniSRecEvaluation Protocol=fine-tuned2026.05 | 13.6 | 29.8 | 43.5 | 13.6 | 22.7 | 28.4 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=rank. only2026.05 | 12.3 | 20.7 | 27.1 | 12.3 | 17.1 | 19.7 | |
| Zero-shotBackbone=Qwen3-4B, Inference Strategy=two-step2026.05 | 12.1 | 29 | 40 | 12.1 | 21.6 | 26.1 | |
| Zero-shotBackbone=Qwen3-4B, Inference Strategy=single-step2026.05 | 11.9 | 26.7 | 38.8 | 11.9 | 20.3 | 25.2 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=sel. only2026.05 | 10.1 | 25.3 | 36 | 10.1 | 18.9 | 23.3 | |
| BM252026.05 | 8.7 | 18.4 | 27.7 | 8.7 | 14.1 | 17.9 | |
| UniSRecEvaluation Protocol=zero-shot2026.05 | 6.3 | 16.5 | 25.6 | 6.3 | 12 | 15.8 | |
| Random2026.05 | 4.9 | 15.3 | 25.1 | 4.9 | 10.8 | 14.8 | |
| Zero-shotBackbone=Qwen3.5-2B, Inference Strategy=single-step2026.05 | 3.3 | 4.7 | 5.5 | 3.3 | 4 | 4.4 | |
| Zero-shotBackbone=Qwen3.5-2B, Inference Strategy=two-step2026.05 | 1.2 | 1.8 | 2.2 | 1.2 | 1.5 | 1.7 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=sel. only2026.05 | 0.7 | 1.8 | 2.7 | 0.7 | 1.3 | 1.7 |