# CTR Prediction on MovieLens 20M (test) Source: [CTR Prediction on MovieLens 20M (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:24:23.590Z Evaluation of Click-Through Rate (CTR) prediction performance on the test split of the MovieLens 20M dataset, measured by AUC and F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | CTR Prediction | | Dataset (including any stated split) | MovieLens 20M (test) | | Metric | AUC | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUC](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | AUC | Result date | Report paper | | --- | --- | --- | --- | | KGNN-LS | 97.9 | Not recorded | 68fa65dd1e209131cea0ceef | | KGCN-sum | 97.8 | Not recorded | 68fa65a71e209131cea0b9c1 | | KGCN-concat | 97.7 | Not recorded | 68fa65a71e209131cea0b9c1 | | KGCN-neighbor | 97.7 | Not recorded | 68fa65a71e209131cea0b9c1 | | KGCN-avg | 97.5 | Not recorded | 68fa65a71e209131cea0b9c1 | | RippleNet | 96.8 | Not recorded | 68fa65a71e209131cea0b9c1 | | LibFM + TransE | 96.6 | Not recorded | 68fa65a71e209131cea0b9c1 | | LibFM + TransE | 96.6 | Not recorded | 68fa65dd1e209131cea0ceef | | SVD | 96.3 | Not recorded | 68fa65a71e209131cea0b9c1 | | SVD | 96.3 | Not recorded | 68fa65dd1e209131cea0ceef | | RippleNet | 96 | Not recorded | 68fa65dd1e209131cea0ceef | | LibFM | 95.9 | Not recorded | 68fa65a71e209131cea0b9c1 | | LibFM | 95.9 | Not recorded | 68fa65dd1e209131cea0ceef | | CKE | 92.4 | Not recorded | 68fa65a71e209131cea0b9c1 | | CKE | 92.4 | Not recorded | 68fa65dd1e209131cea0ceef | | PER | 83.2 | Not recorded | 68fa65a71e209131cea0b9c1 | | PER | 83.2 | Not recorded | 68fa65dd1e209131cea0ceef | ### KGNN-LS AUC: 97.9. Result ID: 698cce998b517eb4331ce1c7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### KGCN-sum AUC: 97.8. Result ID: 698cc0338b517eb4331c7ceb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"aggregator":"sum"}. This record does not assert independent reproduction. ### KGCN-concat AUC: 97.7. Result ID: 698cc0338b517eb4331c7cec. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"aggregator":"concat"}. This record does not assert independent reproduction. ### KGCN-neighbor AUC: 97.7. Result ID: 698cc0338b517eb4331c7ced. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"aggregator":"neighbor"}. This record does not assert independent reproduction. ### KGCN-avg AUC: 97.5. Result ID: 698cc0338b517eb4331c7cee. [Reporting paper]() Recorded evaluation configuration: {"aggregator":"average"}. This record does not assert independent reproduction. ### RippleNet AUC: 96.8. Result ID: 698cc0338b517eb4331c7cea. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LibFM + TransE AUC: 96.6. Result ID: 698cc0338b517eb4331c7ce7. [Reporting paper]() Recorded evaluation configuration: {"Knowledge Graph embedding":"TransE"}. This record does not assert independent reproduction. ### LibFM + TransE AUC: 96.6. Result ID: 698cce998b517eb4331ce1c3. [Reporting paper]() Recorded evaluation configuration: {"TransE dimension":32}. This record does not assert independent reproduction. ### SVD AUC: 96.3. Result ID: 698cc0338b517eb4331c7ce5. [Reporting paper]() Recorded evaluation configuration: {"type":"unbiased"}. This record does not assert independent reproduction. ### SVD AUC: 96.3. Result ID: 698cce998b517eb4331ce1c1. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### RippleNet AUC: 96. Result ID: 698cce998b517eb4331ce1c6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"d":8,"H":2,"lambda1":"10^-6","lambda2":0.01,"eta":0.01}. This record does not assert independent reproduction. ### LibFM AUC: 95.9. Result ID: 698cc0338b517eb4331c7ce6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LibFM AUC: 95.9. Result ID: 698cce998b517eb4331ce1c2. [Reporting paper]() Recorded evaluation configuration: {"dimension":"{1, 1, 8}","training epochs":50}. This record does not assert independent reproduction. ### CKE AUC: 92.4. Result ID: 698cc0338b517eb4331c7ce9. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CKE AUC: 92.4. Result ID: 698cce998b517eb4331ce1c5. [Reporting paper]() Recorded evaluation configuration: {"embedding dimension":64,"KG training weight":0.1}. This record does not assert independent reproduction. ### PER AUC: 83.2. Result ID: 698cc0338b517eb4331c7ce8. [Reporting paper]() Recorded evaluation configuration: {"features":"meta-path based"}. This record does not assert independent reproduction. ### PER AUC: 83.2. Result ID: 698cce998b517eb4331ce1c4. [Reporting paper]() Recorded evaluation configuration: {"meta-paths":"user-movie-director-movie, user-movie-genre-movie, user-movie-star-movie"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.