NQ (Natural Questions)
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
NQ (Natural Questions) in-domain (test)
48.8Exact Match
29
NQ (Natural Questions) (test)
45.3Accuracy
21
NQ (Natural Questions) 2018 Wikipedia dump (dev)
50.2Accuracy
14
NQ (Natural Questions) December 2018 Wikipedia dump (test)
36.9EM
14
NQ (Natural Questions) (full)
40.9Retrieval Accuracy
12
NQ (Natural Questions) (out-of-domain)
14.3F1 Score
3