Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

OpenBookQA dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

OpenBookQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Common-sense QA

OpenbookQA

52.8Accuracy

10

Common-sense reasoning

OpenBookQA (OBQA) (In-Distribution)

88.24Accuracy

9

Commonsense Question Answering

OpenBookQA

44Accuracy

9

Commonsense reasoning

OpenBookQA

81.6ACC

9

OpenBookQA

1.085ECE Gain

8

Question Answering

OpenBookQA

47.6OpenBookQA Score

8

Question Answering

Openbookqa

35.2OpenBookQA Accuracy (Before Attack)

8

Question Answering

OpenBookQA

32Accuracy

7

Scaling Law Prediction

OpenBookQA

0.014MAE

7

Open-book Question Answering

OpenBookQA FS n=30

38.47Accuracy

6

OpenBookQA (test)

54.3Accuracy

6

OpenBookQA (test)

68.2Accuracy

6

OpenBookQA (test)

29.5Accuracy

6

OpenBookQA (test)

57.1Accuracy

6

Open-book Question Answering

OpenBookQA

43.36Score

6

Clarifying Questions

OpenBookQA (test)

28Accuracy

6

Question answering

OpenbookQA ar

53.54Accuracy

6

Question Answering

OpenBookQA

58.4Accuracy (0-shot)

6

Zero-shot Question Answering

OpenBookQA

28.4Accuracy

5

Commonsense Reasoning

OpenBookQA (test)

66.17AUC (%)

5

Commonsense Question Answering

OpenBookQA (OBQA) 1.0 (test)

59.4Accuracy

5

Machine Reading Comprehension

OpenBookQA (test)

55.8Accuracy

5

Question Answering

OpenBookQA bn

33.6Normalized Accuracy

4

Counterfactual Subset-Utility Evaluation

OpenBookQA

0.35Spearman Correlation

4

Multiple Choice Question Answering

OpenBookQA 0-shot (test)

33.2Accuracy

4

Page 3 of 4

Popular tasks

Question Answering Open-Book Question Answering Multiple-choice Question Answering Commonsense Reasoning Commonsense Question Answering

Follow for updates

Join SOTA2 Contact