Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Zero-shot Evaluation research benchmarks · SOTA2 Research

Zero-shot Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Downstream Tasks Zero-shot

76Accuracy

278

Feb 26, 2026

7 tasks zero-shot

72.79Mean Accuracy (Zero-shot)

223

Jun 25, 2026

Downstream Tasks MMLU, PIQA, Arc-E, Arc-C, Wino, OpenQA

77.62MMLU

218

Feb 26, 2026

Arc-Challenge, Arc-Easy, HellaSwag, LAMBADA-openai, LAMBADA-standard, PIQA, and WinoGrande Zero-Shot

76.71Accuracy (0-shot)

123

Jun 12, 2026

Eight datasets average

Surrogate-Assisted Layer Contribution Estimation

63.54Accuracy

112

May 26, 2026

PIQA, WinoGrande, HellaSwag, ARC (Easy and Challenge), LAMBADA (test)

77.07Average Accuracy

102

Jul 9, 2026

Zero-shot Tasks Average

68.05Accuracy

95

Jul 9, 2026

9 diverse tasks zero-shot

73.81Average Accuracy (Zero-shot)

85

May 27, 2026

Zero-shot Evaluation Suite (ARC, Hellaswag, LAMBADA, PIQA, Winogrande)

73.39ARC-C

85

May 20, 2026

Zero-shot Evaluation Suite (ARC-c, ARC-e, HellaSwag, PIQA, WinoGrande)

59.3ARC-c Accuracy

82

Jun 4, 2026

Evaluation Tasks Zero-shot Aggregate

79.95Avg. Accuracy

74

May 20, 2026

6 zero-shot downstream tasks

80.05Average Accuracy

70

May 19, 2026

ArcC, ArcE, HS, PiQA, WG (test val)

76Average Accuracy

61

Feb 26, 2026

Zero-shot Benchmarks Average

68.6Average Accuracy

60

Jun 11, 2026

ARC-Easy, ARC-Challenge, OpenBookQA, WinoGrande, PIQA, HellaSwag, MathQA, RTE, BoolQ zero-shot

Original (Dense)

71.08Mean Accuracy

59

Mar 10, 2026

ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, RTE, WinoGrande Zero-shot

72.9Accuracy

57

Apr 7, 2026

Evaluation Benchmarks Zero-shot

71.76Average Accuracy

55

Jun 4, 2026

Various Tasks Average (test)

79.95Average Accuracy

38

Feb 26, 2026

Benchmarks 0-shot

73.330-shot Average Score

33

Jul 9, 2026

Downstream Tasks PiQA ARC Hellaswag Winogrande BoolQ

84.4PiQA Accuracy (Zero-shot)

30

Apr 10, 2026

Eight tasks zero-shot

60.31Accuracy (Zero-shot)

29

Apr 30, 2026

Zero-shot Evaluation Suite

77.28Average Score

29

Jun 5, 2026

Zero-shot Tasks

73.99Task Avg Score

26

May 19, 2026

ARC-Challenge, ARC-Easy, BoolQ, CrowS-Pairs, OpenBookQA, PIQA, RACE, SiQA, TruthfulQA, WinoGrande zero-shot

52.1ARC-C Accuracy

26

Mar 10, 2026

Tasks Zero-shot (mean)

76.57mAcc

25

Feb 26, 2026

Page 1 of 3

PreviousNext

Popular datasets

Downstream Tasks Evaluation Suite Tasks LM Evaluation Harness Reasoning Tasks

Follow for updates

Join SOTA2 Contact