Amazon Reviews
Benchmarks
TaskDatasetSOTA resultTrendResults
Amazon Reviews Toys (test)
0.033HR@1
11
Amazon Reviews Beauty (test)
3.29HR@1
11
Amazon Reviews CDs & Vinyl 2023 (test)
32.16ROUGE-1
10
Amazon Reviews Movies & TV 2023 (test)
0.314ROUGE-1
10
Amazon Reviews Books 2023 (test)
0.395ROUGE-1
10
Amazon Reviews
85.7Accuracy
10
Amazon reviews
11.99PPL (Pos.)
10
Amazon Reviews (Out-of-domain)
84.7Accuracy
10
Amazon Reviews Game 2023 (test)
43SR
10
Amazon Book Reviews 2023 (test)
63SR
10
Amazon Reviews
7.523Aspect Entropy
9
Amazon Reviews
10.067Item Entropy
9
Amazon Reviews
1Pearson Correlation Coefficient
9
Amazon Reviews
85.32Accuracy (Books)
9
Amazon reviews Last Tasks (Final task of sequence)
87.99Accuracy
8
Amazon reviews All Tasks Average over 24
85.24Accuracy
8
Amazon Reviews
0.782Performance B->D
7
Amazon Reviews Sports & Outdoors 2023 (test)
30.04ROUGE-1
6
Amazon Reviews Musical Instruments 2023 (test)
0.245ROUGE-1
6
Amazon Reviews Video Games 2023 (test)
29.28ROUGE-1
6
Amazon Reviews
0.193BLEU
6
Amazon Reviews full
11.9Recall@10
6
Amazon Reviews
97.8OOD AUPRC
6
Amazon Reviews Arts, Crafts & Sewing (cold-start)
57.9H@1
6
Amazon Reviews Sports & Outdoors (cold-start)
51.3Hit Rate @ 1
6