Natural Questions
Benchmarks
TaskDatasetSOTA resultTrendResults
Natural Questions (NQ) (test)
58.4Exact Match (EM)
134
Natural Questions (NQ)
0ASR
99
Natural Questions (NQ)
0.019Relative Overhead (%)
90
Natural Questions (NQ)
60.7Exact Match (EM)
82
Natural Questions (NQ) (test)
76Exact Match
77
NQ (Natural Questions)
0ORR
72
Natural Questions (test)
61.65EM
72
NQ (Natural Questions)
78.3EM
70
Natural Questions
0ASR
63
Natural Questions (test)
92.1Top-5 Recall
62
NQ (Natural Questions) (test)
68.6Accuracy
60
NQ (Natural Questions)
72EM
52
Natural Questions
70.58EM
52
Natural Questions (NQ)
49.3Accuracy
48
Natural Questions (NQ)
100wAA (%)
45
Natural Questions (NQ) (test)
100AUROC
45
Natural Questions (NQ) (test)
68Robust Accuracy
45
Natural Questions (NQ) (Evaluation)
83Accuracy
45
Natural Questions (NQ) (test)
85.2Top-20 Accuracy
45
Natural Questions (NQ) (test)
58.15Accuracy
44
Natural Questions (test)
100Top-1 Accuracy
40
Natural Questions
100Recall@1
40
Natural Questions
64.08E2E-ASR
36
Natural Questions
46.39Accuracy
36
Natural Questions
0.982Recall@5
35