HotpotQA
Benchmarks
TaskDatasetSOTA resultTrendResults
HotpotQA (test)
67.5Ans EM
37
HotpotQA
76Exact Match (EM)
36
HotpotQA
75EM
36
HotpotQA
69.5F1 Score
36
HotpotQA (val)
100Precision
36
HotpotQA
75Recall@5
35
HotpotQA
45EM
35
HotpotQA fullwiki (val)
58.3Exact Match (EM)
34
HotpotQA distractor setting (test)
82.2Answer F1
34
HotPotQA
82.7Success Rate
33
HotpotQA
100Guard Rate
32
HotpotQA (test)
56.2EM
32
HotpotQA
78.2Performance Score
32
HotpotQA
92.52Avg@8 Accuracy
32
HotpotQA (test)
96.8Recall@5
31
HotpotQA
64.5F1 Score
31
HotpotQA (val)
79Exact Match
31
HotpotQA
95.4Recall
31
HotpotQA
84.5Accuracy (alpha=0.10)
30
HotpotQA
90ASR
30
HotpotQA Distractor
75Exact Match (EM)
30
HotpotQA
44.2Accuracy
30
HotpotQA-E 2018 (Full)
78F1 Score
30
HotpotQA
26ACC
30
HotpotQA
62.6Accuracy
29