TriviaQA
Benchmarks
TaskDatasetSOTA resultTrendResults
TriviaQA
0.98AUROC
625
TriviaQA (test)
98.3AUC-ROC
255
TriviaQA
86.68Accuracy
238
TriviaQA (val)
0.904AUROC
199
TriviaQA
86.1EM
182
TriviaQA (val)
87.9PRR
175
TriviaQA
72EM
147
TriviaQA
88AUROC
129
TriviaQA (test)
85.18Accuracy
121
TriviaQA
94.5Accuracy
117
TriviaQA
0.999AUROC
113
TriviaQA (test)
87.91AUROC
110
TriviaQA
76.1EM
88
TriviaQA
0.889QE5 Score
80
TriviaQA (test)
92.1EM
80
TriviaQA (test)
72.6Exact Match
80
TriviaQA
62EM
71
TriviaQA (test)
0Fail Rate
70
TriviaQA (test)
90.1Top-100 Acc
67
TriviaQA
87.4ROC-AUC
66
TriviaQA
92.42BS (%)
65
TriviaQA
75ACC
62
TriviaQA (test)
66Accuracy
60
TriviaQA open (test)
73.3EM
59
TriviaQA (TQA)
71.1EM
56