Recommendation on Netflix (test)
39.5NDCG@100ELSA
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ELSAEmbedding size (B)=98002026.02 | 39.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EASEEmbedding size (B)=710762026.02 | 39.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Compressed ELSAEmbedding size (B)=10242026.02 | 39.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pruned EASEEmbedding size (B)=10242026.02 | 38.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Compressed ELSAEmbedding size (B)=5122026.02 | 38.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pruned EASEEmbedding size (B)=5122026.02 | 38.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Compressed ELSAEmbedding size (B)=2562026.02 | 38.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pruned EASEEmbedding size (B)=2562026.02 | 37.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Low-Dim. ELSAEmbedding size (B)=10242026.02 | 37.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Compressed ELSAEmbedding size (B)=1282026.02 | 37.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ∞-AEUser-sampling budget=25K (5.4% users)2022.06 | 36.59 | 96.63 | 29.69 | 50.88 | 30.59 | 3.75 | — | — | — | — | — | — | — | — | |
| Pruned EASEEmbedding size (B)=1282026.02 | 36.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Low-Dim. ELSAEmbedding size (B)=5122026.02 | 36.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Compressed ELSAEmbedding size (B)=642026.02 | 35.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DISTILL-CF + ∞-AEUser budget=5002022.06 | 35.58 | 97.28 | 29.57 | 49.24 | 30.54 | 3.62 | — | — | — | — | — | — | — | — | |
| LightGCN2022.06 | 35.09 | 94.18 | 26.03 | — | — | 3.59 | — | — | — | — | — | — | — | — | |
| Low-Dim. ELSAEmbedding size (B)=2562026.02 | 34.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pruned EASEEmbedding size (B)=642026.02 | 34.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELSA + SAEEmbedding size (B)=10242026.02 | 34.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELSA + SAEEmbedding size (B)=5122026.02 | 33.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Low-Dim. ELSAEmbedding size (B)=1282026.02 | 33 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELSA + SAEEmbedding size (B)=2562026.02 | 32.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELSA + SAEEmbedding size (B)=1282026.02 | 32 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELSA + SAEEmbedding size (B)=642026.02 | 31.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Low-Dim. ELSAEmbedding size (B)=642026.02 | 30.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EASE2022.06 | 29.22 | 94.95 | 20.6 | 44.53 | 20.85 | 2.77 | — | — | — | — | — | — | — | — | |
| PopRec2022.06 | 17.79 | 92.49 | 12.14 | 28.47 | 12.34 | 1.45 | — | — | — | — | — | — | — | — | |
| MF2022.06 | 17.17 | 92.34 | 11.69 | 27.72 | 12.04 | 1.31 | — | — | — | — | — | — | — | — | |
| Bias only2022.06 | 16.95 | 92.34 | 11.49 | 27.66 | 11.72 | 1.28 | — | — | — | — | — | — | — | — | |
| NeuMF2022.06 | 16.4 | 92.44 | 11.06 | 26.76 | 11.48 | 1.21 | — | — | — | — | — | — | — | — | |
| AB-RecCategory=Multimodal, Year=KDD’25, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 58.65 | 80.94 | 43.9 | 52.43 | |
| BiasMFBackbone=BiasMF, Setting=Full-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 7.9 | 14.51 | 13.75 | 14.15 | — | — | — | — | |
| BiasMFBackbone=BiasMF, Setting=Zero-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 3.11 | 7.69 | 1.67 | 2.92 | — | — | — | — | |
| BM3Category=Multimodal, Year=WWW’23, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 58.25 | 81.55 | 42.13 | 53.58 | |
| CL4SRecCategory=Traditional, Year=ICDE’22, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 57.88 | 78.73 | 43.74 | 50.91 | |
| GRU4RecCategory=Traditional, Year=ICLR’16, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 51.52 | 71.52 | 36.59 | 44.94 | |
| LATTICECategory=Multimodal, Year=MM’21, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 56.35 | 79.55 | 41.1 | 50.38 | |
| LightGCNBackbone=LightGCN, Setting=Full-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 4.67 | 8.15 | 14.88 | 14.24 | — | — | — | — | |
| LightGCNBackbone=LightGCN, Setting=Zero-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 9.74 | 12.56 | 4.46 | 4.15 | — | — | — | — | |
| LightGCNCategory=Traditional, Year=SIGIR’20, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 54.3 | 74.2 | 39.28 | 47.02 | |
| LLaRACategory=LLM-based, Year=SIGIR’24, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 56.5 | 77 | 40.72 | 48.54 | |
| MLLM-MSRCategory=MLLM-based, Year=AAAI’25, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 59.1 | 80.8 | 44.29 | 52.72 | |
| MLLMRec-R1Category=MLLM-based, Year=Ours, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 71.5 | 86.7 | 59.02 | 62.93 | |
| MoRecCategory=Multimodal, Year=SIGIR’23, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 57.42 | 77.25 | 42.77 | 48.87 | |
| MSRBenchCategory=MLLM-based, Year=WWW’25, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 57.2 | 78.2 | 42.95 | 50.29 | |
| NCFBackbone=NCF, Setting=Full-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 5.81 | 9.36 | 18.48 | 17.21 | — | — | — | — | |
| NCFBackbone=NCF, Setting=Zero-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 4.8 | 11.58 | 1.96 | 3.84 | — | — | — | — | |
| RecLM (BiasMF)Backbone=BiasMF, Setting=Full-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 8.68 | 17.61 | 16.3 | 16.54 | — | — | — | — | |
| RecLM (BiasMF)Backbone=BiasMF, Setting=Zero-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 13.81 | 14.9 | 8.28 | 5.84 | — | — | — | — | |
| RecLM (LightGCN)Backbone=LightGCN, Setting=Full-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 6.52 | 10.26 | 17.03 | 16.06 | — | — | — | — | |
| RecLM (LightGCN)Backbone=LightGCN, Setting=Zero-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 13.71 | 14.53 | 6.97 | 4.59 | — | — | — | — | |
| RecLM (NCF)Backbone=NCF, Setting=Full-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 5.91 | 9.68 | 19.03 | 17.85 | — | — | — | — | |
| RecLM (NCF)Backbone=NCF, Setting=Zero-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 17 | 17.74 | 9.84 | 9.74 | — | — | — | — | |
| RecLM (SGL)Backbone=SGL, Setting=Full-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 7.88 | 12.04 | 19.58 | 18.31 | — | — | — | — | |
| RecLM (SGL)Backbone=SGL, Setting=Zero-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 11.26 | 17.56 | 3.84 | 10.66 | — | — | — | — | |
| RecLM (SimGCL)Backbone=SimGCL, Setting=Full-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 5.67 | 9.08 | 17.82 | 16.73 | — | — | — | — | |
| RecLM (SimGCL)Backbone=SimGCL, Setting=Zero-Shot, Variant=Augment2024.12 | — | — | — | — | — | — | 15.08 | 18.95 | 15.5 | 16.47 | — | — | — | — | |
| RecZeroCategory=LLM-based, Year=NIPS’25, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 65.2 | 82.05 | 51.95 | 58.57 | |
| SASRecCategory=Traditional, Year=ICDM’18, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 55.6 | 75.7 | 40.42 | 47.86 | |
| SGLBackbone=SGL, Setting=Full-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 2.77 | 4.16 | 8.55 | 7.62 | — | — | — | — | |
| SGLBackbone=SGL, Setting=Zero-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 3.85 | 14.41 | 2.74 | 5.79 | — | — | — | — | |
| SimGCLBackbone=SimGCL, Setting=Full-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 2.31 | 4.41 | 8.1 | 8.25 | — | — | — | — | |
| SimGCLBackbone=SimGCL, Setting=Zero-Shot, Variant=Base2024.12 | — | — | — | — | — | — | 7.93 | 12.59 | 3.36 | 4.6 | — | — | — | — | |
| SPRecCategory=LLM-based, Year=WWW’25, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 57.65 | 79.82 | 42.5 | 51.67 | |
| TallRecCategory=LLM-based, Year=Recsys’23, Candidate set size=102026.03 | — | — | — | — | — | — | — | — | — | — | 56.9 | 78.85 | 41.74 | 49.67 |