Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

OpenBookQA dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

OpenBookQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Question Answering

OpenBookQA

100Attack Success Rate (ASR)

20

OpenBookQA (test)

92.31Accuracy

19

Question Answering

OpenBookQA

85.1Accuracy

17

Question Answering

OpenBookQA

47OpQA Score

15

Question Answering

OpenBookQA

0.157Mean Per-Step Regret

15

Commonsense Reasoning

OpenBookQA

75.6Accuracy (Inter-layer)

15

Question Answering

OpenBookQA

7.2Accuracy Improvement Delta

14

Question Answering

OpenBookQA Official Leaderboard

95.2Accuracy

14

Open-book Question Answering

OpenBookQA n=991 (20%)

57.52Accuracy

13

Open-book Question Answering

OpenBookQA 5% n=298

53.6Accuracy

13

Commonsense Reasoning

OpenBookQA

51.4Normalized Accuracy (OpenBookQA)

13

Reading Comprehension

OpenBookQA

96Accuracy

13

Text Common-sense & Reading

OpenBookQA

98.6Score

12

Question Answering

OpenBookQA

95.48Accuracy (Q)

12

Question Answering

OpenBookQA

0.874Accuracy

12

Rationale Support Quality and Alignment

OpenBookQA

97.58Rationale Quality (Q)

12

Audio Question-Answering

OpenBookQA

91.4Score

12

Open Book Question Answering

OpenBookQA

89.4Normalized Log Accuracy

12

Question Answering

OpenBookQA D^v (train)

100Accuracy

12

Question Answering

OpenbookQA

88Open Accuracy

12

Question Answering

OpenBookQA (D_eval)

75.4Accuracy

12

Question Answering

OpenBookQA D (train)

94.6Accuracy

12

Question Answering

OpenBookQA D^x (train)

93.5Accuracy

12

Question Answering

OpenBookQA

98Accuracy

11

Question Answering

OpenBookQA

1.51Empirical Generalization Error G(W)

10

Page 2 of 4

Popular tasks

Question Answering Open-Book Question Answering Multiple-choice Question Answering Commonsense Reasoning Commonsense Question Answering

Follow for updates

Join SOTA2 Contact