Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Commonsense Reasoning research benchmarks – Page 16 · SOTA2 Research

Commonsense Reasoning

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

ARC Challenge Turkish

36.55Accuracy

3

Mar 6, 2026

64Score

3

Feb 27, 2026

3.9Average Relative Improvement

3

Feb 26, 2026

2.79Avg Relative Improvement

3

Feb 26, 2026

3.81Average Relative Improvement

3

Feb 26, 2026

0.761Pass@1

3

Feb 26, 2026

XCOPA Indonesian

Transport and Merge

60Accuracy

3

Feb 26, 2026

Last Letters (test)

Ours (Natural Program (NP), No Verification)

92.98Accuracy

3

Feb 26, 2026

86Accuracy

3

Feb 26, 2026

77.94Accuracy

3

Feb 26, 2026

66.7Accuracy

3

Feb 26, 2026

Sports Understanding

0.668Accuracy

3

Feb 26, 2026

Date Understanding

16.3Accuracy

3

Feb 26, 2026

94Accuracy

3

Feb 26, 2026

MCTS + EquivPruner

57Accuracy

2

Jun 23, 2026

41.1Accuracy

2

May 27, 2026

WinoGrande XL (val)

53.43Accuracy

2

May 19, 2026

71.7Score

2

May 15, 2026

Commonsense Reasoning Suite (OBQA, HellaSwag, ARC-E, WSC, Winogrande, BoolQ, PIQA)

49.4Average Accuracy

2

May 15, 2026

Hellaswag fewshot=10 (test)

PhiMoE (FP16 baseline)

88.57Accuracy

2

Apr 23, 2026

24.2pass@1

2

Apr 21, 2026

HellaSwag 200 samples

Gemma 3 12B IT (Base)

0.67Log-likelihood Score

2

Apr 2, 2026

79.3Normalized Log Accuracy

2

Mar 18, 2026

0.012MAE

2

Feb 26, 2026

HellaSwag Finance

77Accuracy

2

Feb 26, 2026

Page 16 of 17

Popular datasets

HellaSwag WinoGrande Commonsense Reasoning Commonsense Reasoning Suite CommonsenseQA

Follow for updates

Join SOTA2 Contact