Amazon
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Amazon Sports
0.3Time per Sample (s)
3
amazon ADBench
11.8F1 Score
3
Amazon M2 (test)
37.61NDCG@10
3
Amazon Toys 5-core (test)
3.56Recall@5
3
Amazon
42.2Correctness
3
Amazon
396.64Running Time (s)
3
Amazon CSJ
1.03RMSE
3
Amazon
42.01AUPRC
3
Amazon (test)
16Communication Rounds
3
Amazon (Out-of-Distribution)
92.3Accuracy
3
Amazon Computer (production)
82.29Accuracy
3
Amazon 3M
35.2Latency (ms/sample)
3
Amazon computers
59.67Accuracy
3
Amazon
89.7Coverage
2
Amazon Sports
21.92Recall@50 Improvement (vs Random Selection)
2
Amazon Beauty
21.56Cold Recall@50 Improvement vs Random
2
Amazon (test)
1.19R@10
2
Amazon
0.16Time per Epoch (h)
2
Amazon (test)
42.5Win Ratio
2
Amazon Games
13.4Recall@10
2
Amazon
6.471Average Latency (s)
2
AMAZON
14Distinct-1
2
Amazon-5 (3m examples) (test)
34.17Error Rate
2
Amazon (test)
62.3Exact Match
2
Amazon (test)
59.5Sentiment Accuracy
2