Amazon
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Amazon Toys 2018 (test)
6.63Recall@10
7
Amazon Beauty 2018 (test)
0.069Recall@10
7
Amazon Sports 2018 (test)
3.95Recall@10
7
Amazon Baby Products 2023 (test)
0.016Recall@10
7
Amazon Beauty 2023 (test)
3.87Recall@10
7
Amazon-16 CDs -> Books (test)
29.58HR@10
7
Amazon CDs 16
0.527HR@5
7
Amazon-8@CDs
0.428HR@5
7
Amazon CDs 4
45.88HR@5
7
Amazon Books 16
0.502HR@5
7
Amazon-8 Books
53HR@5
7
Amazon Books 4
49.41HR@5
7
Amazon Movies TV (test)
62Binary Accuracy
7
Amazon Photo
110Degree
7
Amazon
0.472CTC Score
7
Amazon
60.45Accuracy
7
Amazon Electronics
0.034F1@20
7
Amazon Fully-Supervised
98.69AUROC
7
Amazon 5-star (test)
66Accuracy
7
Amazon2 binarized (test)
96Accuracy
7
Amazon Wilds (test)
71.9Average Accuracy
7
Amazon Wilds (val)
72.7Average Accuracy
7
Amazon Computers
0.016Training Time per Epoch (s)
7
AMAZON
76.3AMAZON Score
7
Amazon 175 LFs (test)
92.93F1 Score
7