Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

BigBench-Hard dataset and benchmarks · SOTA2 Research

Research Datasets

BigBench-Hard

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Logical Reasoning

BigBench Hard Boolean Expressions

76.8Accuracy

17

BigBench Hard Penguins

44.1Accuracy

5

Linguistic Reasoning

BigBench Hard Disambiguation QA

55.1Accuracy

5

BigBench-Hard collection averaged

45.41Ours Accuracy

4

Popular tasks

Reasoning Logical reasoning Linguistic Reasoning

Follow for updates

Join SOTA2 Contact