WinoGrande
Benchmarks
TaskDatasetSOTA resultTrendResults
WinoGrande
7,364Accuracy
1,581
Winogrande
85.3Accuracy
453
Winogrande
91.3Accuracy
189
WinoGrande (WG)
85.2Accuracy
172
Winogrande (WG)
74.1Accuracy
138
WinoGrande
80.51Accuracy
107
Winogrande
76.09Accuracy
103
Winogrande
74.9Accuracy
94
WinoGrande
77.82Accuracy
89
WinoGrande (val)
73.88Accuracy
87
WinoGrande 5-shot
92.66Accuracy
85
Winogrande
95Accuracy
72
Winogrande
85.64Accuracy
67
WinoGrande
89.4Accuracy
64
Winogrande
82.35Accuracy
61
Winogrande
73.7Accuracy (0-shot)
42
WinoGrande
76.56Accuracy
39
WinoGrande standard (test)
80.2Accuracy
39
WinoGrande (WG)
77.5Accuracy
38
WinoGrande
80.82Accuracy
38
WinoGrande 1.0 (test)
74.1Accuracy
31
WinoGrande
20.91Percentage of Zeroed Heads
30
Winogrande
59Accuracy
30
WinoGrande
77.3Zero-shot Accuracy
30
WinoGrande 2021
78.06Normalized Accuracy
26