Recommendation on Goodreads (test)
70.24N@5KPOCL
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KPOCLDescription=KPO with K-aware curriculum learning2025.05 | 70.24 | 51.58 | 87.35 | 96.67 | 73.53 | — | — | — | — | — | — | |
| KPOBackbone=Llama-3.2-3B-Instruct2025.05 | 69.94 | 50.42 | 87.19 | 95.84 | 72.72 | — | — | — | — | — | — | |
| DPOPLBackbone=Llama-3.2-3B-Instruct2025.05 | 68.76 | 48.59 | 86.19 | 96.34 | 72.05 | — | — | — | — | — | — | |
| DPOBackbone=Llama-3.2-3B-Instruct2025.05 | 68.58 | 49.08 | 85.69 | 95.84 | 72.16 | — | — | — | — | — | — | |
| KPOCUTBackbone=Llama-3.2-3B-Instruct2025.05 | 68.52 | 49.92 | 84.53 | 94.68 | 71.82 | — | — | — | — | — | — | |
| KTOBackbone=Llama-3.2-3B-Instruct2025.05 | 68.08 | 48.75 | 84.86 | 95.34 | 71.47 | — | — | — | — | — | — | |
| SimPOBackbone=Llama-3.2-3B-Instruct2025.05 | 67.94 | 48.42 | 85.69 | 95.51 | 71.13 | — | — | — | — | — | — | |
| LlamaRecModel Category=LLM-based Ranker2025.05 | 67.65 | 48.42 | 84.19 | 95.01 | 71.14 | — | — | — | — | — | — | |
| S-DPOBackbone=Llama-3.2-3B-Instruct2025.05 | 67.12 | 48.42 | 83.53 | 94.84 | 70.83 | — | — | — | — | — | — | |
| SFTModel Category=Baseline2025.05 | 66.75 | 48.09 | 83.69 | 94.68 | 70.34 | — | — | — | — | — | — | |
| cDPOBackbone=Llama-3.2-3B-Instruct2025.05 | 66.51 | 45.09 | 85.36 | 95.34 | 69.79 | — | — | — | — | — | — | |
| LLaRAModel Category=LLM-based Recommendation Model2025.05 | 63.41 | 47.42 | 80.53 | 92.35 | 67.13 | — | — | — | — | — | — | |
| CaserModel Category=Traditional Recommendation Model2025.05 | 62.51 | 41.33 | 80.83 | 92.83 | 66.4 | — | — | — | — | — | — | |
| SASRecModel Category=Traditional Recommendation Model2025.05 | 57.63 | 36.61 | 76.54 | 91.18 | 62.38 | — | — | — | — | — | — | |
| GRU4RecModel Category=Traditional Recommendation Model2025.05 | 56.06 | 34.78 | 75.04 | 92.51 | 61.85 | — | — | — | — | — | — | |
| MoRecModel Category=LLM-based Recommendation Model2025.05 | 52.4 | 31.11 | 71.21 | 89.18 | 58.24 | — | — | — | — | — | — | |
| RankGPT3.5Model Category=LLM-based Ranker2025.05 | 46.74 | 33.89 | 57.63 | 72.88 | 51.58 | — | — | — | — | — | — | |
| Mult-DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 12.88 | — | — | — | — | — | — | — | — | 16.78 | 17.85 | |
| D3Mode=SFT-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 12.54 | — | — | — | — | — | — | — | — | 15.31 | 16.78 | |
| LiPO (BT)Mode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 12.52 | — | — | — | — | — | — | — | — | 16.11 | 17.31 | |
| S-DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 11.81 | — | — | — | — | — | — | — | — | 15.86 | 16.93 | |
| BigRecMode=SFT-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 11.09 | — | — | — | — | — | — | — | — | 15.27 | 16.82 | |
| Mult-DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 9.47 | — | — | — | — | — | — | — | — | 12.92 | 14.06 | |
| DMPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 9.32 | — | — | — | — | — | — | — | — | 12 | 13.59 | |
| Vanilla DPOMode=DPO-based, Backbone=Qwen2.5-3B-Instruct2026.06 | 8.7 | — | — | — | — | — | — | — | — | 11.2 | 12.02 | |
| LiPO (BT)Mode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 8.62 | — | — | — | — | — | — | — | — | 11.98 | 12.94 | |
| D3Mode=SFT-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 8.18 | — | — | — | — | — | — | — | — | 11.22 | 12.1 | |
| BigRecMode=SFT-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 7.76 | — | — | — | — | — | — | — | — | 10.69 | 11.77 | |
| S-DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 7.62 | — | — | — | — | — | — | — | — | 11.05 | 11.92 | |
| DMPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 5.86 | — | — | — | — | — | — | — | — | 8.05 | 8.45 | |
| Vanilla DPOMode=DPO-based, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 3.89 | — | — | — | — | — | — | — | — | 5.58 | 6.22 | |
| Qwen2.5-3B-InstructMode=zero-shot, Backbone=Qwen2.5-3B-Instruct2026.06 | 1.49 | — | — | — | — | — | — | — | — | 1.84 | 1.84 | |
| Qwen2.5-0.5B-InstructMode=zero-shot, Backbone=Qwen2.5-0.5B-Instruct2026.06 | 0.85 | — | — | — | — | — | — | — | — | 0.9 | 0.9 | |
| AlphaRecBackbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 1.16 | 2.36 | — | 0.76 | 1.14 | 1.52 | 3.86 | — | — | |
| CaserMethod Type=Traditional2026.01 | — | — | 1.26 | 2.42 | — | 0.71 | 1.09 | 1.52 | 4.12 | — | — | |
| Caser*Backbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL2026.01 | — | — | 1.5 | 2.64 | — | 1 | 1.36 | 1.75 | 4.18 | — | — | |
| CoT-RLBackbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 1.36 | 1.87 | — | 1.07 | 1.21 | 1.76 | 3.58 | — | — | |
| D3Backbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 5.32 | 6.82 | — | 3.87 | 4.36 | 4.74 | 8.3 | — | — | |
| GRU4RecMethod Type=Traditional2026.01 | — | — | 1.08 | 1.52 | — | 0.74 | 0.88 | 1.13 | 2.52 | — | — | |
| GRU4Rec*Backbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL2026.01 | — | — | 5.02 | 6.12 | — | 3.95 | 4.3 | 4.71 | 7.76 | — | — | |
| LatentR3Backbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 4.08 | 4.96 | — | 3.14 | 3.42 | 3.77 | 6.36 | — | — | |
| RISERBackbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 5.44 | 7 | — | 4.2 | 4.7 | 5.15 | 8.78 | — | — | |
| S-DPOBackbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL, Beam Search Width=202026.01 | — | — | 4.08 | 5.6 | — | 3.21 | 3.71 | 4.14 | 7.34 | — | — | |
| SASRecMethod Type=Traditional2026.01 | — | — | 3.62 | 4.82 | — | 2.54 | 2.93 | 3.27 | 6.18 | — | — | |
| SASRec*Backbone LLM=Qwen2-1.5B, Training Protocol=SFT + RL2026.01 | — | — | 5.32 | 6.26 | — | 3.81 | 4.11 | 4.46 | 7.66 | — | — |