SST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SST-5 (test)
35.1Macro F1
3
SST In-distribution
94.7Accuracy
3
SST-2 (train)
960,000Parameters (M)
3
SST5 Ali Translate en-zh (test)
60BLEU
3
SST5 Baidu Translate en-fr (test)
0.54BLEU
3
SST 2D adv-diff
8rMAE
2
SST-5
100Recall
2
SST-2
43Peak RAM (RSS) (MB)
2
SST-2 5-shot
80.8Accuracy
2
SST-2 TextFooler attack
17.6Robust Accuracy
2
SST2
98ASR
2
SST-2
90.73ASR
2
SST (test)
90.9EM
2
SST-2
83.2AUC (SST-2)
1
SST-2 (held-out split)
3.25Runtime (s/instance)
1
SST-2
0.37Bound
1
Rendered SST-2
9.79Donor Best Top-1 Accuracy Change
1
SST
0.656RMSE
1
SST2
100GCG Accuracy
1