Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LM Evaluation Suite dataset and benchmarks · SOTA2 Research

Research Datasets

LM Evaluation Suite

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Zero-shot Multiple Choice Question Answering and Reasoning

LM Evaluation Suite ARC, Hellaswag, LogiQA, PiQA, SciQ (test)

23.2ARC-C

8

Zero-shot Downstream Task Evaluation

Zero-shot LM Evaluation Suite (MMLU, HellaSwag, WinoGrande, PIQA, ARC-E, ARC-C, OBQA)

59.8MMLU

6

Popular tasks

Zero-shot Downstream Task Evaluation Zero-shot Multiple Choice Question Answering and Reasoning

Follow for updates

Join SOTA2 Contact