Natural Questions
Benchmarks
TaskDatasetSOTA resultTrendResults
Natural Questions
18.8EN Score
6
Natural Questions abundant
37EM & F1 Score
6
Natural Questions (medium)
36.5F1 Score
6
Natural Questions (scarce)
35.9EM & F1 Score
6
Natural Questions
21.2EM
6
Natural Questions (NQ) (test)
78.5Precision
6
Natural Questions (300 queries)
4.3EM
5
Natural Questions (NQ)
27.1Accuracy
5
Natural Questions (NQ)
58SubEM
5
Natural Questions (NQ) Open-book
87.9Recall
5
Natural Questions (NQ) (test)
36EM
5
Natural Questions (NQ) Karpukhin et al. (val)
16.1EM
5
Natural Questions (NQ)
88.74AUC
5
Natural Questions (test)
37.18QAE EM
5
NQ (Natural Questions)
48.4Evidence Score
4
Natural Questions (NQ)
48.5CoverEM
4
Natural Questions
3.756R@1
4
Natural Questions (NQ) Closed-book
63.8Recall
4
Natural Questions (NQ)
54.48nDCG@10
4
Natural Questions (NQ) Long (dev)
73.2EM
4
BEIR Nat. Questions
0.888nDCG@10
3
Natural Questions (NQ) BEIR
0.58Delta nDCG@10
3
Natural Questions
59.6Accuracy
3
Natural Questions (NQ)
52.72AUC Top-1 Acc
3
Natural Questions (NQ) (dev)
45.6Auto AIS (Before)
3