Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Natural Questions dataset and benchmarks – Page 6 · SOTA2 Research

Research Datasets

Natural Questions

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Open-domain Question Answering

Natural Questions (NQ) full train (test)

60.4EM

3

Question Answering

Natural Questions (NQ) single-answer (test)

54.8Exact Match

3

Question Answering

Natural Questions (NQ) single-answer (dev)

52.8Exact Match

3

Snippet Retrieval

Natural Questions modified (test)

26.92MRR

3

Document Retrieval

Natural Questions modified (test)

40.33MRR

3

Snippet Retrieval

Natural Questions modified

26.92MRR

3

Document Retrieval

modified Natural Questions

40.33MRR

3

Question Answering

Natural Questions (NQ)

0.227Score

2

Question Answering

Natural Questions

15.6PPE

2

Question Answering

Natural Questions (dev)

77.93Long Answer F1

2

Open-domain Question Answering

Natural Questions

26.6Exact Match

2

Page 6 of 6

Popular tasks

Question Answering Open-domain Question Answering Information Retrieval Single-hop Question Answering Document Retrieval

Follow for updates

Join SOTA2 Contact