Amazon Reviews
Benchmarks
TaskDatasetSOTA resultTrendResults
Amazon Reviews Toys & Games (cold-start)
48.7Hit Rate @ 1
6
Amazon Reviews Beauty & Personal care (cold-start)
47.7Hit Rate @ 1
6
Amazon Reviews Music → Books
0.83MAE
6
Amazon Reviews Music → Movies
0.802MAE
6
Amazon Reviews Movies → Books
0.792MAE
6
Amazon Reviews Books → Movies
0.821MAE
6
Amazon Reviews Books → Music
0.788MAE
6
Amazon Reviews
0.05ΔATE
6
Amazon Reviews en ja zh
0.5Acc (de)
6
Amazon Reviews en, es, fr
50.99Accuracy (de)
6
Amazon-reviews sub-benchmarks by cluster unit costs
28Fashion
5
Amazon Reviews (test)
16.7Relative MAE
5
Amazon Reviews Target: 5-star
77Accuracy
5
Amazon Reviews Target: 1-star
64Accuracy
5
Amazon Reviews
97MRR
5
Amazon Reviews (temporal stream)
56Ctot
5
Amazon Reviews Electronics averaged across Env-1, Env-2, Env-3 (test)
0.297NDCG@10
5
Amazon Reviews 2023
0.16HV
4
Amazon Reviews
1.078MAE
4
Amazon Reviews
0.722RefBS-R
4
Amazon Reviews Multi
0.865Accuracy
4
Amazon Reviews Subscription Boxes
0.01NDCG@10
3
Amazon Reviews standard (test)
58.2F1 Score
3
Amazon reviews
0.03Local Average Distance (AD)
2
Amazon Reviews (test)
0.45Correlation
2