Amazon Product Reviews
Benchmarks
TaskDatasetSOTA resultTrendResults
Amazon Product Reviews Video Games leave-one-out (test)
0.023HR@1
12
Amazon Product Reviews Arts, Crafts and Sewing leave-one-out (test)
7.56HR@1
12
Amazon Product Reviews Musical Instruments leave-one-out (test)
8.35HR@1
12
Amazon Product Reviews Sports (test)
0.679AUC
11
Amazon Product Reviews Toys
7.38R@5
9
Amazon Product Reviews Sports
3.85R@5
9
Amazon Product Reviews Beauty
6.83Recall@5
9
Amazon Product Reviews Beauty (test)
35.72Average Text Performance
7
Amazon Product Reviews Toys and Games (test)
35.72Avg Text Performance
7
Amazon Product Reviews Sports and Outdoors (test)
35.72Avg Text Perf.
7
Amazon Product Reviews Third-party (test)
56Helpfulness
4
Amazon Product Reviews Toys (test)
2.574Entropy@10
3
Amazon Product Reviews Beauty (test)
2.551Entropy@10
3
Amazon Product Reviews Scenario 6 MEDIAN
3.2Net Consumption (ALL)
1
Amazon Product Reviews Scenario 5 LOW
4.5Net Consumption (ALL)
1
Amazon Product Reviews Scenario 3 HIGH
3.3Net Consumption (ALL) (%)
1
Amazon Product Reviews Scenario 2 HIGH
3.8Net Consumption (ALL)
1
Amazon Product Reviews Scenario 1 HIGH
4.1Net Consumption (ALL)
1
Amazon Product Reviews Base
3.6Net Consumption (ALL)
1