Sequential Recommendation on Amazon Office (test)
47.75NDCG@10AgenticRec
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| AgenticRecCategory=Ours2026.03 | 47.75 | — | 77.73 | — | 24.94 | 57.55 | 41.23 | — | — | |
| ReReCategory=Trainable LLM-based Recommenders2026.03 | 45.79 | — | 69.62 | — | 26.01 | 50.52 | 39.7 | — | — | |
| LLaRACategory=Trainable LLM-based Recommenders2026.03 | 43.98 | — | 64.96 | — | 24.16 | 50.07 | 39.28 | — | — | |
| InteRecAgentCategory=Training-free LLM-based Recommenders2026.03 | 37.17 | — | 60.56 | — | 19.11 | 44.67 | 32.11 | — | — | |
| SASRecCategory=Conventional Sequential Recommenders2026.03 | 35.25 | — | 58.63 | — | 16.62 | 42.7 | 30.18 | — | — | |
| S-DPOCategory=Trainable LLM-based Recommenders2026.03 | 35.22 | — | 54.21 | — | 15.73 | 35.28 | 25.13 | — | — | |
| CaserCategory=Conventional Sequential Recommenders2026.03 | 35.11 | — | 55.41 | — | 17.71 | 43.74 | 31.39 | — | — | |
| GRU4RecCategory=Conventional Sequential Recommenders2026.03 | 34.9 | — | 57.05 | — | 16.42 | 43.24 | 30.54 | — | — | |
| ReaRecCategory=Conventional Sequential Recommenders2026.03 | 34.57 | — | 55.51 | — | 17.16 | 42.65 | 30.49 | — | — | |
| TALLRecCategory=Trainable LLM-based Recommenders2026.03 | 33.18 | — | 55.22 | — | 15.39 | 35.92 | 25.43 | — | — | |
| LLMRankCategory=Training-free LLM-based Recommenders2026.03 | 26.65 | — | 55.76 | — | 7.13 | 31.02 | 18.72 | — | — | |
| SIDReasonerBackbone=Qwen3-1.7B2026.03 | 12.08 | — | — | — | — | — | 11.19 | 13.73 | 16.48 | |
| LETTER2026.03 | 11.39 | — | — | — | — | — | 10.74 | 13.15 | 15.2 | |
| TIGER2026.03 | 11.21 | — | — | — | — | — | 10.37 | 12.7 | 14.29 | |
| HSTU2026.03 | 11.07 | — | — | — | — | — | 10.69 | 12.04 | 13.23 | |
| ReaRec2026.03 | 10.57 | — | — | — | — | — | 9.88 | 11.73 | 13.85 | |
| Fine-tuneBackbone=RecFormer-base2026.01 | 10.36 | — | — | — | — | — | — | — | — | |
| R^2ec2026.03 | 10.04 | — | — | — | — | — | 8.94 | 11.47 | 14.86 | |
| SASRec2026.03 | 8.71 | — | — | — | — | — | 8.24 | 10.19 | 11.67 | |
| LCRec2026.03 | 8.67 | — | — | — | — | — | 6.99 | 9.64 | 14.87 | |
| TIESBackbone=RecFormer-large2026.01 | 8.33 | — | — | — | — | — | — | — | — | |
| TIESBackbone=BLaIR-large2026.01 | 8.28 | — | — | — | — | — | — | — | — | |
| TIESBackbone=BLaIR-base2026.01 | 8.16 | — | — | — | — | — | — | — | — | |
| Caser2026.03 | 7.38 | — | — | — | — | — | 6.63 | 8.8 | 11.14 | |
| GRU4Rec2026.03 | 5.74 | — | — | — | — | — | 4.8 | 6.82 | 9.74 | |
| SpecTranBackbone=BERT4Rec2026.01 | 4.89 | 6.29 | 9.83 | 15.4 | — | — | — | — | — | |
| SpecTranBackbone=SASRec2026.01 | 4.71 | 6.12 | 10.03 | 15.67 | — | — | — | — | — | |
| SpecTranBackbone=HSTU2026.01 | 4.45 | 5.78 | 9.3 | 14.63 | — | — | — | — | — | |
| BaseBackbone=BERT4Rec2026.01 | 4.13 | 5.49 | 8.05 | 13.46 | — | — | — | — | — | |
| BaseBackbone=HSTU2026.01 | 3.26 | 4.36 | 6.54 | 10.91 | — | — | — | — | — | |
| LBRBackbone=BIGRec2026.07 | 3.21 | — | 7.58 | — | — | 4.57 | 2.24 | — | — | |
| BaseBackbone=SASRec2026.01 | 3.09 | 4.23 | 6.74 | 11.3 | — | — | — | — | — | |
| LBRBackbone=LLaRA2026.07 | 3 | — | 6.23 | — | — | 3.53 | 2.13 | — | — | |
| S-DPOBackbone=BIGRec2026.07 | 2.92 | — | 6.29 | — | — | 3.74 | 2.09 | — | — | |
| CFTBackbone=BIGRec2026.07 | 2.72 | — | 5.82 | — | — | 3.06 | 1.83 | — | — | |
| IGDBackbone=BIGRec2026.07 | 2.66 | — | 5.66 | — | — | 3.12 | 1.87 | — | — | |
| CFTBackbone=LLaRA2026.07 | 2.54 | — | 5.97 | — | — | 3.37 | 1.68 | — | — | |
| DROS2026.07 | 2.4 | — | 4.05 | — | — | 2.65 | 1.95 | — | — | |
| D3Backbone=LLaRA2026.07 | 2.4 | — | 6.18 | — | — | 2.34 | 1.16 | — | — | |
| D3Backbone=BIGRec2026.07 | 2.37 | — | 5.92 | — | — | 2.91 | 1.42 | — | — | |
| LLaRA2026.07 | 2.36 | — | 6.13 | — | — | 2.18 | 1.08 | — | — | |
| DLLM2Rec2026.07 | 2.31 | — | 5.3 | — | — | 3.22 | 1.66 | — | — | |
| BIGRec2026.07 | 2.26 | — | 5.87 | — | — | 2.13 | 1.05 | — | — | |
| S-DPOBackbone=LLaRA2026.07 | 2.16 | — | 5.77 | — | — | 2.13 | 1.01 | — | — | |
| DC4SRLLM Backbone=Llama-3 3B, Adapter=LoRA2026.04 | 2.12 | 2.63 | 4.47 | 6.91 | — | 2.91 | 1.61 | — | — | |
| IGDBackbone=LLaRA2026.07 | 2.12 | — | 5.82 | — | — | 2.29 | 0.99 | — | — | |
| SASRec2026.04 | 2.06 | 2.59 | 4.31 | 6.44 | — | 2.86 | 1.59 | — | — | |
| LLM-CF2026.07 | 2 | — | 4.26 | — | — | 3.06 | 1.61 | — | — | |
| SASRec2026.07 | 1.96 | — | 4.47 | — | — | 2.23 | 1.27 | — | — | |
| LLM4DSR2026.04 | 1.87 | 2.45 | 4.21 | 6.6 | — | 1.97 | 1.13 | — | — | |
| ReweightBackbone=LLaRA2026.07 | 1.85 | — | 4.78 | — | — | 2.34 | 1.06 | — | — | |
| IADSR2026.04 | 1.36 | 2.1 | 3.38 | 6.34 | — | 1.61 | 0.8 | — | — | |
| FMLP-Rec2026.04 | 1.31 | 1.93 | 3.01 | 5.45 | — | 1.82 | 0.92 | — | — | |
| ReweightBackbone=BIGRec2026.07 | 1.22 | — | 3.38 | — | — | 1.25 | 0.53 | — | — | |
| CL4Rec2026.04 | 0.72 | 1.19 | 1.66 | 3.58 | — | 0.68 | 0.41 | — | — | |
| BERT4Rec2026.04 | 0.65 | 0.81 | 1.35 | 2.03 | — | 0.94 | 0.51 | — | — | |
| AlignRecMMRS type=Alignment-based2026.03 | — | 6.56 | — | 14.46 | — | — | — | — | — | |
| AnchorRecMMRS type=Alignment-based2026.03 | — | 6.94 | — | 15.13 | — | — | — | — | — | |
| BM3MMRS type=Alignment-based2026.03 | — | 5.32 | — | 11.44 | — | — | — | — | — | |
| DA-MRSMMRS type=Alignment-based2026.03 | — | 7.01 | — | 14.75 | — | — | — | — | — | |
| FREEDOMMMRS type=Accuracy-oriented2026.03 | — | 6.85 | — | 14.66 | — | — | — | — | — | |
| LATTICEMMRS type=Accuracy-oriented2026.03 | — | 6.36 | — | 13.85 | — | — | — | — | — | |
| LGMRecMMRS type=Accuracy-oriented2026.03 | — | 6.9 | — | 14.74 | — | — | — | — | — | |
| SMOREMMRS type=Accuracy-oriented2026.03 | — | 7.73 | — | 16.19 | — | — | — | — | — | |
| VBPRMMRS type=Accuracy-oriented2026.03 | — | 5.05 | — | 10.69 | — | — | — | — | — |