LLM Benchmark Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LLM Benchmark Suite (MMLU, ARC-C, PIQA, WinoG, GSM8K, HellaSwag, GPQA, RACE) (test)
57.93Overall Accuracy
13
10 LLM benchmark suite macro-average
71.8PASS-AT-1 Accuracy
9
Loading the SOTA2 catalog…