Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Question Answering research benchmarks – Page 102 · SOTA2 Research

Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

4.49GenericJudge Score

4

Apr 8, 2026

NarrativeQA Peter Rabbit

16Exact Match

4

Apr 7, 2026

PubMedQA Zero-Context Setting (test)

Llama 3.1 8B Instruct

64.77Accuracy

4

Apr 3, 2026

85.4EM

4

Apr 3, 2026

eManual RAGBench (test)

48.11Mean Faithfulness Score

4

Apr 1, 2026

COVID-QA RAGBench (test)

38.23FC Mean

4

Apr 1, 2026

Medical Question Answering Benchmarks Aggregate (test)

RAG (w/ Training Set)

701Prompt Tokens

4

Mar 31, 2026

TriviaQA no ctx

Qwen-7B† / Llama-3-8B

59Accuracy (General)

4

Mar 27, 2026

29.3pass@1

4

Mar 26, 2026

KaLMv2 + Qwen3-235B

1.988R@1

4

Mar 26, 2026

KaLMv2 + Qwen3-235B

3.497R@1

4

Mar 26, 2026

KaLMv2 + Llama3.3

3.337Recall@1

4

Mar 26, 2026

KaLMv2 + Qwen3-235B

3.212R@1

4

Mar 26, 2026

KaLMv2 + Llama3.3

4.547R@1

4

Mar 26, 2026

KaLMv2 + Llama3.3

4.051R@1

4

Mar 26, 2026

Natural Questions

KaLMv2 + Llama3.3

3.756R@1

4

Mar 26, 2026

KaLMv2 + Qwen3-235B

2.886Recall@1

4

Mar 26, 2026

2Wiki 100 sampled queries

0.67Latency (s)

4

Mar 24, 2026

QuALITY multiple choice (test)

86.09Accuracy

4

Mar 20, 2026

Task 2 Cross-domain

59.4Answer Accuracy

4

Mar 19, 2026

Task 2 Single-domain

79.98Answer Accuracy

4

Mar 19, 2026

47.9Accuracy

4

Mar 18, 2026

84.8Normalized Log Accuracy

4

Mar 18, 2026

65.5Compressed Accuracy

4

Mar 18, 2026

77.2Normalized Log Accuracy

4

Mar 18, 2026

Page 102 of 122

Popular datasets

HotpotQA TriviaQA ARC NQ SQuAD

Follow for updates

Join SOTA2 Contact