Recommender System Frameworks Comparison 2024
0BiasLibRec
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LibRecSearch Alg.=true, Seed=true2026.02 | 0 | 0 | 0 | 0 | — | 55 | 10 | 11 | |
| MyMediaLiteSearch Alg.=true, Seed=true2026.02 | 0 | 0 | 0 | 0 | — | 18 | 6 | 8 | |
| SurpriseCloud I/O=true, Search Alg.=true, Seed=true2026.02 | 0 | 0 | 0 | 0 | — | 7 | 6 | 4 | |
| SpotlightSearch Alg.=true, Seed=true2026.02 | 0 | 0 | 0 | 0 | — | 2 | 2 | 4 | |
| CornacEager (Pandas)=true, Search Alg.=true, Seed=true, Checkpoint=true2026.02 | 0 | 0 | 0 | 0 | — | 58 | 4 | 12 | |
| FuxiCTREager (Pandas)=true, Fast (Polars)=true, Search Alg.=true, Seed=true, Checkpoint=true2026.02 | 0 | 0 | 0 | 0 | — | 51 | 2 | 4 | |
| InformfullyEager (Pandas)=true, Search Alg.=true, Seed=true2026.02 | 0 | 0 | 10 | 0 | — | 10 | 5 | 22 | |
| MS RecommendersEager (Pandas)=true, Distrib. (Spark)=true, Multi-GPU (DDP)=true, Cluster (Ray)=true, Search Alg.=true, Pruning (ASHA)=true, Callbacks=true, Seed=true, Checkpoint=true2026.02 | 0 | 1 | 4 | 0 | — | 15 | 3 | 15 | |
| MerlinEager (Pandas)=true, Fast (Polars)=true, Distrib. (Spark)=true, Cloud I/O=true, Multi-GPU (DDP)=true, Cluster (Ray)=true, Search Alg.=true, Pruning (ASHA)=true, Callbacks=true, Agentic AI=true, REST API=true, Seed=true, Checkpoint=true2026.02 | 0 | 0 | 0 | 0 | — | 8 | 8 | 5 | |
| DaisyRecEager (Pandas)=true, Search Alg.=true, Seed=true2026.02 | 1 | 0 | 2 | 0 | — | 13 | 7 | 11 | |
| ClayRSEager (Pandas)=true, Seed=true, Checkpoint=true, Paired (T/Wilc)=true, Indep (Kru/Whi)=true, FWER (Bonf)=true, FDR (Ben-Hoch)=true2026.02 | 1 | 1 | 3 | 0 | — | 17 | 3 | 15 | |
| RecListEager (Pandas)=true, Search Alg.=true, Seed=true2026.02 | 1 | 3 | 1 | 0 | — | — | — | 15 | |
| LensKitEager (Pandas)=true, Fast (Polars)=true, Multi-GPU (DDP)=true, Cluster (Ray)=true, Search Alg.=true, Seed=true, Checkpoint=true2026.02 | 2 | 0 | 3 | 0 | — | 12 | 5 | 11 | |
| RecBoleEager (Pandas)=true, Multi-GPU (DDP)=true, Search Alg.=true, Callbacks=true, Seed=true, Checkpoint=true2026.02 | 2 | 0 | 3 | 0 | — | 159 | 8 | 16 | |
| ElliotEager (Pandas)=true, Search Alg.=true, Pruning (ASHA)=true, Seed=true, Paired (T/Wilc)=true2026.02 | 5 | 9 | 6 | 0 | — | 77 | 13 | 38 | |
| WarpRecEager (Pandas)=true, Fast (Polars)=true, Distrib. (Spark)=true, Cloud I/O=true, Multi-GPU (DDP)=true, Cluster (Ray)=true, Search Alg.=true, Pruning (ASHA)=true, Callbacks=true, Agentic AI=true, REST API=true, Paired (T/Wilc)=true, Indep (Kru/Whi)=true, FWER (Bonf)=true, FDR (Ben-Hoch)=true, Seed=true, Checkpoint=true, Carbon Track=true, Energy Report=true2026.02 | 5 | 10 | 6 | 2 | — | 55 | 19 | 40 |