SST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SST-5 (200-Pos)
98.7Positive Realization (%)
6
SST-5 No-Pos (test)
87.7Positive Rate
6
sst2
60.5Runtime (ms/instance)
5
SST2
60.5Execution Time (ms)
5
sst5
1.3Relative Accuracy Improvement
5
SST-2
94.99Accuracy
5
SST-2
92.5Classification Accuracy (CA)
5
SST-2
93Accuracy
5
SST-5
67Success Rate (SST-5)
5
SST-2
97Success Rate
5
SST-2
68.1ROC-AUC
5
SST 1/4° 2021 (test)
0.216CRPS
5
SST 1-week horizon
0.146MSE
5
SST 2-week horizon
0.204MSE
5
SST 4-week horizon
0.281MSE
5
BiasedSST (test)
95.9Average Accuracy
5
SST-2 GLUE (test)
92.7Accuracy
5
SST-5
16.3Macro F1
5
SST-5 (All)
84.2Accuracy
5
SST-2
99.65Similarity Score
5
SST-5 (full data)
55.79Accuracy
4
SST
100Accuracy (Clean, Eager)
4
SST Attacked (dev)
48.83Accuracy
4
SST Original (dev)
83.88Accuracy
4
SST-2
97.2Accuracy
4