Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-Book Question Answering research benchmarks · SOTA2 Research

Open-Book Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

OpenBookQA 1.0 (test)

TituLLM-3b-v2.0

35Accuracy

33

Feb 26, 2026

NQ-Open Open-Book

79.51Exact Match

17

Jun 4, 2026

OpenBookQA n=991 (20%)

57.52Accuracy

13

Jun 24, 2026

OpenBookQA 5% n=298

53.6Accuracy

13

Jun 24, 2026

89.4Normalized Log Accuracy

12

Mar 26, 2026

OpenBookQA FS n=30

38.47Accuracy

6

Jun 24, 2026

43.36Score

6

Apr 1, 2026

RealtimeQA December 16, 2022

55EM

6

Feb 26, 2026

12.8Normalized PLL Score

4

Feb 26, 2026

Popular datasets

OpenBookQA OBQA NQ RealtimeQA

Follow for updates

Join SOTA2 Contact