WinoGrande
Benchmarks
TaskDatasetSOTA resultTrendResults
Winogrande Small (In-Distribution)
78.82Accuracy
9
Ko-Winogrande
86.2EM
9
WinoGrande
53.49Accuracy
9
WinoGrande Corrupt Setting
56Accuracy
8
WinoGrande Clean Setting
73.9Accuracy
8
WinoGrande Medium
0.765Accuracy
8
WinoGrande Small (WG-S)
70.43Accuracy
8
Winogrande 5-shot
0.749Normalized Log Accuracy
8
Winogrande s (subsampled_2500)
0.725Accuracy
8
Winogrande ET
65.1Winogrande ET Accuracy
8
Winogrande v1.1 (test)
91.28Accuracy
8
WinoGrande
58.3FA Score (WinoGrande)
7
WinoGrande
0.015MAE
7
WINOGRANDE (test)
0.714AUC
7
WinoGrande (test)
58.68Single Accuracy
7
WinoGrande
59.43Accuracy
7
Winogrande (Evaluation)
58Accuracy
6
WINOGRANDE Synonym Replacement WordNet-based (test)
66AUC
6
WINOGRANDE (test)
4.5Failure Rate
6
Winogrande 2012
57.4Accuracy
6
Winogrande
81.1Winogrande Accuracy
5
WinoGrande (leaderboard)
0.94AUC
5
Winogrande XS, S, M, L, XL partitions 1.0
78.8Accuracy (XS)
5
WinoGrande
60.14Accuracy (40% Sparsity)
4
Winogrande zero-shot
67.17Accuracy (zero-shot)
4