Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 96 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

2-Hop QA Full Knowledge

Thinking States

54.91Acc

5

Feb 26, 2026

RULER-HQA 1.75M context length

LycheeMemory-7B w/o Gate

78.12Sub-EM Accuracy

5

Feb 26, 2026

AgriRegion-Eval 160 questions (test)

76EM

5

Feb 26, 2026

Babilong 128k context length

38QA1 Score

5

Feb 26, 2026

Babilong 64k context length

25QA1 Score

5

Feb 26, 2026

Long-context QA Evaluation Suite (NarrativeQA, HotpotQA, 2wikimqa, MFQA_en, Qasper, Musique) (test)

15.69NarrativeQA Score

5

Feb 26, 2026

PIQA 64 query samples

Victim Model (GPT-3.5-turbo)

82.8Accuracy

5

Feb 26, 2026

4.96Helpfulness

5

Feb 26, 2026

31.1Score

5

Feb 26, 2026

LongBench-SingleDoc (test)

26.8Score (2k tokens)

5

Feb 26, 2026

MeetingBank (test)

76.22QA Score

5

Feb 26, 2026

MeetingBank in-domain (test)

87.75EM

5

Feb 26, 2026

KORANI Multiple Choice QA

86.4Doc QA Accuracy

5

Feb 26, 2026

ViNewsQA (test)

77.53EM

5

Feb 26, 2026

wizardlm-v1.2-13b

28.3AQUA-RAT

5

Feb 26, 2026

NaturalQuestions (val)

5.7Exact Match

5

Feb 26, 2026

16.6Exact Match

5

Feb 26, 2026

79.84QA Swahili Score

5

Feb 26, 2026

Knowledge Tasks (test)

75.93ARC (easy) Accuracy

5

Feb 26, 2026

Question Answering (QA)

Multi-task learning

25.65ARG (QA->QA) (%)

5

Feb 26, 2026

TbQA MRQA few-shot

83.2F1 Score

5

Feb 26, 2026

TriviaQA MRQA few-shot

80.7F1 Score

5

Feb 26, 2026

QASC MRQA few-shot

99.1F1 Score

5

Feb 26, 2026

BioASQ MRQA few-shot

94.2F1 Score

5

Feb 26, 2026

SQuAD MRQA few-shot

93.5F1 Score

5

Feb 26, 2026

Page 96 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact