HellaSwag
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HellaSwag published (test)
82.35Accuracy
15
HellaSwag EN
76.53Accuracy
14
HellaSwag (test)
85.34HellaSwag Score
14
Hellaswag 24 official EU languages
84.3Accuracy
14
HellaSwag
78.9Accuracy
14
M-HellaSwag
1.014Performance
13
HellaSwag (test)
80.1Accuracy
13
HellaSwag
76.7Accuracy
13
Hellaswag
0.696AUROC
12
HellaSwag In-Domain (IND-MGT)
96.3Accuracy
12
HellaSwag
44.3Accuracy
12
HellaSwag SAGE-generated
74.17Overall Accuracy (OA)
12
HellaSwag
59.1Accuracy
12
HellaSwag
1.5ECE (15-bin)
11
HellaSwag
66.87Character Accuracy
11
HellaSwag (HS) 10k (test)
0.8MAE
11
HellaSwag
0.58NLL
10
HellaSwag
76Accuracy
10
HellaSwag
70.5Accuracy
10
HellaSwag Arabic
39.25Accuracy (Normalized)
10
HellaSwag non-IID distribution, alpha=0.1
58.47Accuracy
10
HellaSwag IID distribution
77.82Accuracy
10
HELLASWAG (dev)
95.7Accuracy
10
HellaSwag
70.16HellaSwag Accuracy
9
HellaSwag
58.5Accuracy
9