Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering and Commonsense Reasoning research benchmarks · SOTA2 Research

Question Answering and Commonsense Reasoning

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Short-context benchmarks ARC-C, ARC-E, PIQA, Winogrande, HellaSwag

63.48ARC-C Accuracy

45

Apr 21, 2026

NLP Benchmark Suite Zero-shot (HellaSwag, RACE, PIQA, WinoGrande, ARC, OBQA) (test)

63.36HellaSwag Accuracy

28

May 14, 2026

Zero-Shot Evaluation Suite (Arc-e, Arc-c, Boolq, Hellaswag, Openbookqa, Piqa, SciQ, Winogrande)

65.74ARC-E

18

Feb 26, 2026

LM Eval ARCC, ARCE, HellaSwag, PIQA 0.4.4 standard (test)

61.6ARCC

18

Feb 26, 2026

lm-eval-harness PIQA, COPA, OpenBookQA, Winogrande, SciQA, ARC-E, ARC-C

78.8PIQA Accuracy

10

Feb 26, 2026

LM Evaluation Harness ARC-C, ARC-E, BoolQ, HellaSwag, LAMBADA, PiQA, WinoGrande zero-shot SlimPajama data-restricted scenario

25.76ARC-C

6

Jun 4, 2026

Downstream Tasks (ARC-C, HellaSwag, PIQA, WinoGrande) zero-shot

55.8ARC-C Accuracy

3

May 11, 2026

Popular datasets

LM Eval Evaluation Suite LM Evaluation Harness lm-eval-harness NLP Benchmark Suite

Follow for updates

Join SOTA2 Contact