Amazon
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Amazon
28.07AUPRC (Zero-shot)
4
Amazon E → N v1
96.41AUROC
4
Amazon N → E v1
82.64AUROC
4
Amazon Movies
0.134Recall@20
4
Amazon Tense (test)
97Accuracy
4
Amazon (test)
0.027Querying Time (s)
4
Amazon (test)
0.025Querying Time (s)
4
Amazon-670K
23.3Inference Time (ms/sample)
4
Amazon-3M large scale XMC (test)
21.38PSP@1
4
Amazon photos
71.64ACC
4
Amazon (test)
63.9F1 Score
4
Amazon (dev)
0.635F1 Score
4
Amazon Overall (test)
0.084Classification Loss
4
Amazon Extreme (test)
0.08Loss
4
Amazon Bulk (test)
0.085Loss
4
Amazon
83.6Sentiment Preservation
4
Amazon Large
94F1 Score
4
Amazon Medium
86.3F1 Score
4
Amazon-5 (test)
31.67Error Rate
4
Amazon Women v1 (test)
0.948AUC
4
Amazon Women v1 (test)
95.8AUC
4
Amazon
13Latency (s)
3
Amazon (70%)
92MF1
3
Amazon hard cases
0.48F1-score
3
Amazon Sports (test)
17.3NDCG@10
3