SST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SST-5 40%S (test)
55.62Accuracy
8
SST-5
57Macro F1
7
SST-2 (test)
89Accuracy
7
SST
100Safety Score
7
SST-2
90.34SST-2 Accuracy
7
SST-2 BITE Full attack (test)
66.2ASR
7
SST-2 Syntactic attack (test)
33.9ASR
7
SST-2
0.81Kendall Correlation
7
SST-2 (All)
94.7Accuracy
7
SST-2 IMDb
0.778Kendall's Tau
6
SST-2
0.976Raw ρ
6
SST-5 (train)
52.4Accuracy
6
SST-2
-0.151MIDPUT_conf
6
SST5
50.42Accuracy (%)
6
SST2P
8Fid-
6
SST L=45 (test)
0.739RMSE
6
SST L=30 (test)
0.351RMSE
6
SST L=15 (test)
0.609RMSE
6
SST-2
92.89Accuracy
6
SST-5
53.12Accuracy
6
SST-5
42.4Macro-F1
6
SST
53AP
6
SST-2 → IMDB (test)
92.72ASR
6
SST
55.8Top-1 Accuracy
6
SST-2
93.4macro-F1
6