Standard evaluation suite (LAMBADA, ARC, HellaSwag, PIQA, WinoGrande)
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Standard short-context evaluation suite (LAMBADA, ARC, HellaSwag, PIQA, WinoGrande)
57.3LAMBADA PPL Score
18
Loading the SOTA2 catalog…