Sequential Recommendation on LastFM (Recall/NDCG@1, 3, 5)
50.8Recall@1GRU4Rec
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GRU4Rec2026.05 | 50.8 | 69 | 75.5 | 50.8 | 61.3 | 64 | |
| F-GRPOBackbone=Qwen3-4B2026.05 | 46.8 | 72.4 | 81.7 | 46.8 | 61.7 | 65.5 | |
| GRPOBackbone=Qwen3-4B2026.05 | 44.7 | 55.1 | 73.9 | 44.7 | 50.8 | 58.6 | |
| SFTBackbone=Qwen3-4B2026.05 | 40.1 | 47.1 | 53.8 | 40.1 | 44 | 46.8 | |
| F-GRPOBackbone=Qwen3.5-2B2026.05 | 40 | 63.2 | 74.3 | 40 | 53.5 | 58.1 | |
| GRPOBackbone=Qwen3.5-2B2026.05 | 38.7 | 60.4 | 71.3 | 38.7 | 51.3 | 55.8 | |
| SFTBackbone=Qwen3.5-2B2026.05 | 37.9 | 45.4 | 52.6 | 37.9 | 42.1 | 45.1 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=full2026.05 | 33.4 | 40.4 | 46.3 | 33.4 | 37.4 | 39.8 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=full2026.05 | 32.4 | 40.1 | 46.1 | 32.4 | 36.9 | 39.3 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=rank. only2026.05 | 28.8 | 42.9 | 51.9 | 28.8 | 37 | 40.7 | |
| Popularity2026.05 | 24.7 | 45.9 | 56.6 | 24.7 | 36.9 | 41.3 | |
| UniSRecEvaluation Protocol=fine-tuned2026.05 | 23.9 | 42.2 | 54.7 | 23.9 | 34.5 | 39.6 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=rank. only2026.05 | 23.1 | 31.6 | 38.3 | 23.1 | 28 | 30.8 | |
| Zero-shotBackbone=Qwen3-4B, Inference Strategy=single-step2026.05 | 20.6 | 43.8 | 55.8 | 20.6 | 34.3 | 39.2 | |
| Zero-shotBackbone=Qwen3-4B, Inference Strategy=two-step2026.05 | 18.8 | 44.7 | 58.4 | 18.8 | 34 | 39.6 | |
| Decoupled SFTBackbone=Qwen3-4B, Variant=sel. only2026.05 | 14.1 | 33.3 | 46 | 14.1 | 25.3 | 30.5 | |
| UniSRecEvaluation Protocol=zero-shot2026.05 | 11 | 25.4 | 36.9 | 11 | 19.2 | 23.9 | |
| BM252026.05 | 6.2 | 17.8 | 27.7 | 6.2 | 12.8 | 16.8 | |
| Random2026.05 | 5 | 15 | 25.1 | 5 | 10.6 | 14.7 | |
| Zero-shotBackbone=Qwen3.5-2B, Inference Strategy=single-step2026.05 | 3.1 | 6.5 | 8.1 | 3.1 | 5.1 | 5.7 | |
| Zero-shotBackbone=Qwen3.5-2B, Inference Strategy=two-step2026.05 | 0.6 | 1.6 | 2.3 | 0.6 | 1.1 | 1.5 | |
| Decoupled SFTBackbone=Qwen3.5-2B, Variant=sel. only2026.05 | 0.5 | 1.3 | 2 | 0.5 | 0.9 | 1.2 |