MovieLens
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MovieLens Federated Non-IID 10 clients 1M
77.2AUC
3
MovieLens Federated IID 10 clients 1M
79.6AUC
3
MovieLens Centralized 1M (train val test 80-10-10)
84.8AUC
3
MovieLens (held-out)
100Accuracy
3
MovieLens-1M Tiny Scale (temporal holdout)
0.95Prep. Time (s)
3
D2 MovieLens 1M (train/val)
0.855RMSE
3
MovieLens 799 users sampled (test)
72Recall
3
MovieLens ML-1M and ML-100K avg across 4 settings
10.4Time Cost (avg)
3
MovieLens 20M
0.789RMSE (10-NN)
3
MovieLens 10M (test)
0.715MABS
2
MovieLens 1M (test)
0.728MABS
2
MovieLens 80/20 split (test)
0.188Total Variation (TV)
2
MovieLens
226Regret
2
MovieLens 32M Small Scale (temporal holdout)
7.91Preparation Time
2
MovieLens
23.49Precision@20
2
Movielens1M
1Inference Latency (ms)
2
MovieLens
37,829.5Product MAP
2
MovieLens 20M
0.986Pearson Correlation
2
MovieLens non-k-uniform (test)
99.9AUC
2
MovieLens random 25% 10M (test)
0.799Test RMSE
2
MovieLens graph-recommendation substrate appendix
1.976Risk Score
1
MovieLens-20M (test)
4.82Hit Rate@1
1
MovieLens 100K (test)
1.8Hit Rate@1
1
MovieLens
—Primary metric
0