SST-2
Benchmarks
TaskDatasetSOTA resultTrendResults
SST-2 StyleBkd (test)
93.3CACC
7
SST-2 HiddenKiller (test)
92.64Clean Accuracy (CACC)
7
SST-2 Addsent (test)
93.24Clean Accuracy (CACC)
7
SST-2 (dev)
94.9Accuracy
7
SST-2 Style attack (test)
26.7ASR
7
SST-2
91.7Accuracy
6
SST-2 (test)
16,752Number of Queries
6
SST-2 1k (test)
95.3Accuracy
6
SST-2
-0.4Clean Accuracy Delta
6
SST-2
92.1Clean Accuracy
6
SST-2 DistilBERT tokenized vectors (test)
0.002MSE
5
SST-2 RoBERTa tokenized vectors (test)
0.002MSE
5
SST-2 n=128
0Stress
5
SST-2
0.05RelMAE
5
SST-2 (test)
81.65Top-1 Accuracy
5
SST-2
91.38Accuracy
5
SST-2 (test)
97.5Accuracy
5
SST-2 binary
91.2AUC
4
SST-2 TextFooler
17.6Robust Accuracy
4
SST-2 Non-IID
96.07Accuracy
4
SST-2 Style attack
91.1Precision
4
SST-2
100ASR
4
SST-2 (val)
97Accuracy
4
SST-2
273Rollout Time (min)
3
SST-2
0.225Loss
3