SWAG
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SWAG
92.29Accuracy
24
SWAG (test)
0.941Accuracy
13
SWAG (dev)
91.2Accuracy
11
SWAG
0.93Kendall Correlation
10
SWAG (val)
85.5Accuracy
9
SWAG (Generalization)
48.88Accuracy (SWAG Generalization)
8
SWAG In-Domain (test)
83.14Accuracy
8
SWAG (dev)
92.59Accuracy
6
SWAG (test)
88Accuracy
6
SWAG (dev)
86.6Accuracy
4
Swag (test)
80.85Accuracy
3
SWAG (dev)
0.908Accuracy
3