HotpotQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HotpotQA (test)
80.79F1
334
HotpotQA
77.4F1 Score
294
HotpotQA
0.928AUROC
294
HotpotQA
77.2EM
173
HotpotQA
50.2Exact Match (EM)
167
HotPotQA
65.6Exact Match
143
HotpotQA
84.98F1
132
HotpotQA
83.8Accuracy
103
HotPotQA
51.72F1 Score
93
HotpotQA
0.78QE5
80
HotpotQA
74.9F1
79
HotpotQA
80LLM Judge Score
72
HotpotQA In-Distribution
85.2Accuracy
72
HotpotQA (dev)
85.81Answer F1
72
HotpotQA 500 randomly sampled queries (test)
83.25AUROC
70
HotpotQA
0Attack Success Rate (ASR)
69
HotpotQA
96.9R@5
68
HotpotQA
47.1Exact Match (EM)
66
HotpotQA fullwiki setting (test)
75.9Answer F1
64
HotPotQA
79.71AR@5
62
HotpotQA PIA (test)
90.2ASR
62
HotpotQA in-domain
72.4F1 Score
57
HotpotQA
81AUROC
57
HotPotQA
100CoT Match Rate
54
HotpotQA
58.9F1
54