Sequential Recommendation on Amazon Arts (test)
51.91NDCG@10I-LLMRec
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| I-LLMRecModel Category=Image-aware LLM, Representation=Image-based (I)2025.03 | 51.91 | 48.39 | 58.83 | 69.74 | |
| I-LLMRecModel Category=Image-aware LLM, Representation=Image-based (I) + Description-based (D)2025.03 | 51.6 | 47.96 | 59.02 | 69.81 | |
| TRSRModel Category=LLM, Representation=Description-based (D)2025.03 | 51 | 47.58 | 58.41 | 68.96 | |
| A-LLMRecModel Category=LLM, Representation=CF-based (CF)2025.03 | 49.81 | 46.52 | 56.81 | 68.77 | |
| TALLRecModel Category=LLM, Representation=Attributed-based (A)2025.03 | 49.44 | 45.72 | 56.63 | 68.13 | |
| SASRecModel Category=Collaborative Filtering2025.03 | 48.6 | 45.61 | 53.74 | 63.01 | |
| UniMPModel Category=Image-aware LLM, Representation=Image-based (I)2025.03 | 48.29 | 45.65 | 53.15 | 61.31 | |
| VBPRModel Category=Collaborative Filtering2025.03 | 40.62 | 37.1 | 46.56 | 57.45 | |
| BERT4RecModel Category=Collaborative Filtering2025.03 | 39.55 | 36.26 | 44.55 | 54.77 | |
| GRU4RecModel Category=Collaborative Filtering2025.03 | 34.81 | 31.19 | 40.44 | 52.03 | |
| Fine-tuneBackbone=RecFormer-base2026.01 | 11.28 | — | — | — | |
| Fine-tuneBackbone=BLaIR-base2026.01 | 11.19 | — | — | — | |
| Fine-tuneBackbone=RecFormer-large2026.01 | 11.07 | — | — | — | |
| Fine-tuneBackbone=BLaIR-large2026.01 | 10.93 | — | — | — | |
| MergeRec (Domain-wise)Backbone=RecFormer-large2026.01 | 10.66 | — | — | — | |
| TIESBackbone=RecFormer-large2026.01 | 10.42 | — | — | — | |
| Task ArithmeticBackbone=RecFormer-large2026.01 | 10.36 | — | — | — | |
| MergeRec (Layer-wise)Backbone=RecFormer-large2026.01 | 10.34 | — | — | — | |
| MergeRec (Domain-wise)Backbone=RecFormer-base2026.01 | 9.85 | — | — | — | |
| TIESBackbone=RecFormer-base2026.01 | 9.83 | — | — | — | |
| Task ArithmeticBackbone=RecFormer-base2026.01 | 9.75 | — | — | — | |
| MergeRec (Layer-wise)Backbone=RecFormer-base2026.01 | 9.72 | — | — | — | |
| MergeRec (Layer-wise)Backbone=BLaIR-large2026.01 | 9.58 | — | — | — | |
| Weight AveragingBackbone=RecFormer-large2026.01 | 9.56 | — | — | — | |
| MergeRec (Domain-wise)Backbone=BLaIR-large2026.01 | 9.48 | — | — | — | |
| TIESBackbone=BLaIR-large2026.01 | 9.37 | — | — | — | |
| Weight AveragingBackbone=RecFormer-base2026.01 | 9.35 | — | — | — | |
| MergeRec (Domain-wise)Backbone=BLaIR-base2026.01 | 9.1 | — | — | — | |
| Weight AveragingBackbone=BLaIR-large2026.01 | 9.1 | — | — | — | |
| MergeRec (Layer-wise)Backbone=BLaIR-base2026.01 | 9.09 | — | — | — | |
| Joint LearningBackbone=BLaIR-base2026.01 | 8.95 | — | — | — | |
| Joint LearningBackbone=BLaIR-large2026.01 | 8.86 | — | — | — | |
| Weight AveragingBackbone=BLaIR-base2026.01 | 8.79 | — | — | — | |
| AdaMerging (Domain-wise)Backbone=RecFormer-large2026.01 | 8.53 | — | — | — | |
| AdaMerging (Domain-wise)Backbone=RecFormer-base2026.01 | 8.51 | — | — | — | |
| AdaMerging (Layer-wise)Backbone=BLaIR-large2026.01 | 8.1 | — | — | — | |
| TIESBackbone=BLaIR-base2026.01 | 8.08 | — | — | — | |
| Task ArithmeticBackbone=BLaIR-large2026.01 | 8.02 | — | — | — | |
| Joint LearningBackbone=RecFormer-large2026.01 | 7.98 | — | — | — | |
| AdaMerging (Layer-wise)Backbone=RecFormer-large2026.01 | 7.86 | — | — | — | |
| Joint LearningBackbone=RecFormer-base2026.01 | 7.6 | — | — | — | |
| AdaMerging (Domain-wise)Backbone=BLaIR-large2026.01 | 7.48 | — | — | — | |
| Zero-shotBackbone=RecFormer-large2026.01 | 7.2 | — | — | — | |
| Zero-shotBackbone=RecFormer-base2026.01 | 7.17 | — | — | — | |
| AdaMerging (Layer-wise)Backbone=RecFormer-base2026.01 | 6.87 | — | — | — | |
| AdaMerging (Layer-wise)Backbone=BLaIR-base2026.01 | 6.37 | — | — | — | |
| AdaMerging (Domain-wise)Backbone=BLaIR-base2026.01 | 5.77 | — | — | — | |
| Task ArithmeticBackbone=BLaIR-base2026.01 | 5.61 | — | — | — | |
| Zero-shotBackbone=BLaIR-base2026.01 | 3.68 | — | — | — | |
| Zero-shotBackbone=BLaIR-large2026.01 | 3.01 | — | — | — |