WinoGrande
Benchmarks
TaskDatasetSOTA resultTrendResults
Winogrande
62.12Accuracy
4
Winogrande (test)
77.9Score
4
winogrande xl (val)
62.27Median Accuracy
4
Winogrande
70.5Accuracy
4
Winogrande XL (test)
84.6Accuracy
4
WinoGrande
52.54Zero-shot Accuracy
3
WinoGrande
81.5EM Score
3
Winogrande
0.01RMSE
3
Winogrande first 1000 examples (standard)
48.9Accuracy
3
Winogrande
72.1Normalized Log Accuracy
3
Winogrande
2.79Avg Relative Improvement
3
Winogrande v1.1 (val)
77Accuracy
3
WinoGrande
64.5E*S
2
WinoGrande XL (val)
53.43Accuracy
2
Winogrande
71.7Score
2
Winogrande
0.012MAE
2
Winogrande
3.84Time (h)
2