HotpotQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HotpotQA
65F1 Score
2
HotpotQA
1.47Inference Cost (USD)
2
HotpotQA (test)
94.2HS
2
HotpotQA
20.98Accuracy
2
HotpotQA (train)
0.306Accuracy
2
HotpotQA
29.7EM
2
HotpotQA Bridge questions (test val)
50EM
2
HotpotQA Bridge (test)
58.5F1
2
HotpotQA May 2020 (leaderboard)
74.2F1 Score
2
HotpotQA distractor (val)
53.53Answer Accuracy
1
HotpotQA FullWiki adaptive (test)
33.5Base Error Rate
1
HotpotQA adaptive (test)
39.5Base Error Rate
1
HotpotQA FW
26Selection Rate
1
HotpotQA
6Selection Rate
1
HotpotQA FullWiki
0.335Base Error Rate
1
HotpotQA
0.395Base Error
1
HotpotQA
0.436Scalar Regret
1
HotpotQA 35 cells
0Blind Score
1
HotpotQA
74.27Accuracy
1
HotpotQA hard
93.2Accuracy
1
HotpotQA
80.23F1 Score
1
HotpotQA
99.8PoisonedRAG F1
1
HotpotQA
76.4Accuracy (%)
1
HotpotQA (val)
0.6Head Entropy
1
HotpotQA
100CDPA
1