SST-2
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SST-2 (test)
17.69Sufficiency
14
SST-2 (test)
92.66Top-1 Accuracy
12
SST-2
89.84CACC
12
SST-2 (test)
100Attack Success Rate
12
SST-2 original (test)
95.9Accuracy
11
SST-2 32 samples
94.4Accuracy
11
SST-2 full (train)
1,003Steps
10
SST-2 (test)
1Precision
10
SST-2
1.05Latency (hours)
8
SST-2
93Accuracy
8
SST-2
58.5Precision
8
SST-2
205Number of Fine-tuning Rounds
8
SST-2 FTC-metadataset mini (10%) (full dataset 100%)
0.131NLL
8
SST-2 FTC-metadataset full
98.5AURAC
8
SST-2 FTC-metadataset full
0.108NLL
8
SST-2 FTC-metadataset mini 10% 1.0 (test)
98.28AURAC
8
SST-2 GLUE (test dev)
94.2Accuracy
8
SST-2
90.95Acc (20%S)
8
SST-2 (test)
0.03SEAT e-size: Names (Career/Family)
8
SST-2
90.9Average Accuracy
8
SST-2 40%I (test)
95Accuracy
8
SST-2 40%A (test)
95.18Accuracy
8
SST-2 20%A (test)
0.963Accuracy
8
SST-2 40%S (test)
95.75Accuracy
8
SST-2 (test)
1.131FID
7