Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Zero-shot downstream evaluation research benchmarks · SOTA2 Research

Zero-shot downstream evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Downstream Suite Zero-shot (ARC-E, ARC-C, HellaS., PIQA, WG, OBQA, SciQ, BoolQ)

Looped Hybrid (Full+GDN)

74.82ARC-Easy Accuracy

26

May 21, 2026

Downstream Evaluation Suite (ARC, PIQA, HellaSwag, WinoGrande, LAMBADA, RACE) Zero-shot

56.57ARC-E Accuracy

14

May 8, 2026

Downstream Tasks MMLU, HellaSwag, PIQA, BoolQ, WinoGrande, ARC-E, ARC-C, OBQA (500 samples per task)

74.4MMLU

7

Apr 28, 2026

LM Evaluation Harness 0-shot v1.0.0

50.1HellaSwag Accuracy

4

May 20, 2026

Popular datasets

Downstream Tasks LM Evaluation Harness Downstream Suite Downstream Evaluation Suite (ARC, PIQA, HellaSwag, WinoGrande, LAMBADA, RACE)

Follow for updates

Join SOTA2 Contact