HellaSwag
Benchmarks
TaskDatasetSOTA resultTrendResults
HellaSwag
99.21Accuracy
1,896
HellaSwag
87.4HellaSwag Accuracy
897
HellaSwag
87.5Accuracy
440
Hellaswag
93.87Accuracy
213
HellaSwag
93.59Accuracy
212
HellaSwag (HS)
91.84HellaSwag Accuracy
209
HellaSwag
88.97Accuracy
171
HellaSwag
86.63Accuracy
106
HellaSwag (test)
83.9Accuracy
86
HellaSwag
91.84Accuracy
85
HellaSwag (val)
95.3Accuracy
68
HellaSwag (HS)
78.94HS Accuracy
66
HellaSwag
90.92Normalized Accuracy
66
HellaSwag
86.86HellaSwag Score
62
HellaSwag
95.45HellaSwag Score
55
HellaSwag
86HellaSwag Score
53
HellaSwag
76.3Accuracy
53
HellaSwag 0-shot
84.4Accuracy
49
HellaSwag
95.7Accuracy (acc_n)
47
HellaSwag
95.1Accuracy
47
HellaSwag
78.9HS Accuracy
44
Hellaswag
50HS Score
43
HellaSwag
76.36Zero-shot HellaSwag Accuracy
43
HellaSwag
60.04Zero-shot Accuracy
36
HellaSwag
91.7Accuracy
36