HellaSwag
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HellaSwag 2019
54.53Accuracy
6
HellaSwag
0.34HellaSwag Delta
5
HELLASWAG 1800
53.8Accuracy
5
HellaSwag topic-filtered
68.2Accuracy
5
HellaSwag n=50 (val)
56Accuracy
5
HellaSwag
75.5Compression Ratio
5
HellaSwag
52.6HellaS Score
5
HellaSwag (leaderboard)
95.6Accuracy
5
HellaSwag
34.7Accuracy
4
HellaSwag
45.4Best Accuracy
4
HellaSwag
59.9Accuracy
4
HellaSwag
32.98Accuracy
4
HellaSwag
0.061Delta
4
Hellaswag
81.9Accuracy
4
HellaSwag (test)
77.63Accuracy
4
Hellaswag
82.1Score (%)
4
HellaSwag 0-shot (test)
80.79Accuracy (0-shot)
4
HellaSwag
94.6EM
4
HellaSwag 0-shot
79.3Accuracy
4
HellaSwag English
65.7Score
4
HellaSwag (test)
84.89Accuracy
4
HellaSwag
3.25MAE
3
HellaSwag
0.649Kendall's Tau
3
HellaSwag
28.55Normalized Accuracy
3
HellaSwag 5-shot
69.4Accuracy
3