Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

LM Downstream Evaluation Suite dataset and benchmarks · SOTA2 Research

Research Datasets

LM Downstream Evaluation Suite

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Natural Language Understanding

LM Downstream Evaluation Suite (ARC-Easy, ARC-Challenge, BoolQ, CommonsenseQA, HellaSwag, OpenBookQA, PIQA, WinoGrande, MMLU) lm-eval-harness (test)

36.81ARC-Easy Accuracy

12

Popular tasks

Natural Language Understanding

Follow for updates

Join SOTA2 Contact