Ranking on MovieLens 1M Trend Promotion (test)
66.9Hit Rate@5GPT-4o
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-4oCategory=Zero-Shot LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion2026.03 | 66.9 | 71 | 86.8 | 32 | 34.9 | |
| Qwen2.5-3B-Instruct + FlexRecCategory=Post-Trained LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion, Training Condition=trained on Max-Interest2026.03 | 63 | 67.7 | — | 26.9 | 32.9 | |
| Qwen2.5-3B-Instruct + TALLRecCategory=Post-Trained LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion, Training Condition=trained on Max-Interest2026.03 | 61.1 | 64.8 | 84.5 | 24.4 | 32.2 | |
| Qwen2.5-3B-Instruct + Rec-R1Category=Post-Trained LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion, Training Condition=trained on Max-Interest2026.03 | 60.7 | 65.3 | 84.4 | 25.2 | 30.6 | |
| STARCategory=Traditional Rerankers, Generalization Setting=Train: Max-Interest → Test: Trend Promotion2026.03 | 60.4 | 65.5 | 84.4 | 22.8 | 28 | |
| Qwen2.5-3B-InstructCategory=Zero-Shot LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion2026.03 | 58.1 | 62.7 | 83.4 | 22 | 28 | |
| BERT4RecCategory=Traditional Rerankers, Generalization Setting=Train: Max-Interest → Test: Trend Promotion2026.03 | 54.2 | 60.1 | 82 | 18.1 | 21.2 | |
| Qwen2.5-3B-Instruct + Rank-GRPOCategory=Post-Trained LLMs, Generalization Setting=Train: Max-Interest → Test: Trend Promotion, Training Condition=trained on Max-Interest2026.03 | 51 | 57.3 | 80.8 | 13.9 | 18.4 |