Amazon
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Amazon
77.5Micro-F1
4
Amazon N=20,000
0.31MAE CWCE (Equal Binning 15)
4
Amazon Dig. Music
309.9Cumulative Regret
4
AMAZON-13K
78.91nDCG@5
4
Amazon 100 products
1.278Demand Score
4
Amazon 10% training ratio (test)
93.51F1-Macro
4
Amazon 5% training ratio (test)
93.19F1-Macro
4
Amazon 3% training ratio (test)
92.54F1-Macro
4
Amazon2M
91.64Precision
4
Amazon2M
85.08Precision
4
Amazon2M
91.12Precision
4
Amazon Level 3
44.5F1-macro
4
Amazon Level 2
65.4F1-macro
4
Amazon Level 1
90.8Macro F1
4
Amazon Photo
97.7Watermark Alignment
4
amazon ADBench (test)
11.73AUC PR
4
Amazon
94.5F Score
4
Amazon
65,273Output Size
4
Amazon offline-to-online transfer
55.7TCR (%)
4
Amazon Unseen Domains: Instruments, Office, Scientific
10.81Recall@10 (Average)
4
Amazon
0.895IC@50
4
Amazon (test)
0.914RMSE
4
Amazon
85.07F1 Macro
4
Amazon
68.47F1-macro
4
Amazon
78.56AUPRC
4