WSC
Benchmarks
TaskDatasetSOTA resultTrendResults
WSC
98.5Accuracy
116
WSC
80Accuracy
65
WSC
85.2Accuracy@1
33
WSC
86.51Score
30
WSC
0.02Loss
20
WSC (test)
82.7Accuracy
19
WSC (test)
78.8Accuracy (Single)
14
WSC
65.4Accuracy
13
WSC
80.6Accuracy
12
WSC
79.2Accuracy
11
WSC Ambiguity-Augmented (200 samples)
85.2Accuracy@1
11
WSC ambiguity-augmented
82.6Accuracy
11
WSC
116Exact Match (EM)
8
WSC
43.3Accuracy
8
WSC SuperGLUE (test)
65.65Accuracy (Test)
8
WSC standard (test)
56.7Accuracy
8
WSC
98.1AUC
7
WSC
58.36F1 Score
7
WSC
75.7Accuracy (0-shot)
6
WSC (dev)
85.6Accuracy
6
WSC273
82.8Accuracy
5