TriviaQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TriviaQA rc.wikipedia first 200 examples (val)
0Mean Jaccard
2
TriviaQA
62.07Success Rate
2
TriviaQA
89.2Score
2
TriviaQA (held-out val)
48.6Accuracy
2
TriviaQA
4PTR Advancement
2
TriviaQA
92.4Accuracy (%)
2
TriviaQA
0.113PPE
2
TriviaQA
75.7Compressed Accuracy
2
TriviaQA 5-shot
58.5Compression Accuracy
2
TriviaQA
0.026MAE
2
TriviaQA
49.1Accuracy
2
TriviaQA
59.7EM
2
TriviaQA May 2020 (leaderboard)
77.3F1
2
TriviaQA Open-domain Unfiltered
45Exact Match
2
TriviaQA (TQA)
1.7Delta TQA Performance (pp)
1
TriviaQA
75.9Accuracy
1
TriviaQA
83.3Score
1
TriviaQA (val)
0.79Head Entropy
1
TriviaQA single-hop (test)
—Acc
0