HotpotQA
Benchmarks
TaskDatasetSOTA resultTrendResults
HotpotQA distractor setting
52.01Conciseness
21
HotpotQA
93.4Faithfulness
21
HotpotQA December 2018 Wikipedia dump (test)
37.23EM
21
HotpotQA
65.49Mean Score
21
HotpotQA 10 related documents
60.61F1
21
HotpotQA
45.7EM
20
HotpotQA
70.32F1 (56K Context)
20
HotpotQA τ = 96k
86.9E2E Wall Time (s)
20
HotpotQA Wiki-18
44.7Exact Match
20
HotpotQA
62.6Token-level F1
20
HotpotQA
78.4Average Performance Score
20
HotpotQA
60.5EM
20
HotpotQA 128K
24.95F1 Score
20
HotpotQA
47.67F1 Score
20
HotpotQA
56.6EM
20
HotpotQA
58.4EM
20
HotpotQA 296:204 (test)
67.23Answerable EM
20
HotpotQA
94.5LLM Accuracy
20
HotpotQA
58.7F1 Score
20
HotpotQA
45.67Exact Match
20
HotpotQA
42.2EM
20
HotpotQA full wiki (dev)
80.9F1
20
HotpotQA (test val)
36.68EM
20
HotpotQA (test)
42.5EM
19
HotpotQA
50.1ROUGE-L
19