Downstream Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Downstream Suite Zero-shot (ARC-E, ARC-C, HellaS., PIQA, WG, OBQA, SciQ, BoolQ)
74.82ARC-Easy Accuracy
26
Downstream Suite Zero-shot (BoolQ, HellaSwag, PIQA, RACE, WinoGrande)
82.4BoolQ Accuracy
19
Downstream Suite Zero-shot (PIQA, HS, ARC, WG, RTE, OQA, BoolQ)
80.79PIQA Accuracy
12
Downstream Suite
39.38Average Score
8
Downstream Suite (BoolQ, PIQA, HS, WG, ARC-e, ARC-c, OBQA) Zero-shot
77.7Accuracy (BoolQ)
5