TriviaQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TriviaQA (test)
85.5AUROC
8
TriviaQA (TQ) (test)
92.8Mean Correct Answer Rate
8
TriviaQA
0.89AUROC
8
TriviaQA
45Precision@1
8
TriviaQA unfiltered (test)
73.2Accuracy
8
TriviaQA (TQA) (dev)
72.7EM
8
TRIVIAQA (dev)
514.6Word Score
8
TriviaQA
72.94EM
8
TriviaQA
70.4EM
7
TriviaQA Wikipedia-18 retriever context (test)
59.63Exact Match (EM)
7
TriviaQA (TQA)
58.1Accuracy
7
TriviaQA
70.88TriviaQA Accuracy
7
TriviaQA
39.37F1 Score
7
TriviaQA
59.3EM
7
TriviaQA
76.6TriviaQA Score
7
TriviaQA
92.4Accuracy
7
TriviaQA (test)
0.065Expected Calibration Error
7
TriviaQA
88.58Accuracy
7
TriviaQA
0.698EM
7
TriviaQA 50% coverage
74.37F1 Score
7
TriviaQA 20% coverage
81.33F1
7
TriviaQA filtered (dev)
72.5Accuracy
7
TriviaQA unfiltered Hidden set (test)
89.4Exact Match (EM)
7
TriviaQA (TQA) Wiki (test)
75Exact Match
7
TriviaQA Web (Verified)
82.44EM
7