HotpotQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HotpotQA
42.9Exact Match Accuracy (EM)
24
HotpotQA
73.7Mean Accuracy
24
HotpotQA (test)
90.2Accuracy
24
HotpotQA
0.28ECE
24
HotpotQA (test)
91.03Recall@K
24
HotpotQA
67.24HSPP
23
HotpotQA
100Precision @2
23
HotpotQA
72.2Accuracy
23
HotpotQA BEIR
85.1NDCG@10
23
HotpotQA In-Distribution
93.95F1 Score
23
HotpotQA N=1,000 (test)
83.5F1 Score
23
HotpotQA
44.6Exact Match (EM)
22
HotpotQA
38.8Success Rate
22
HotpotQA
48.1Recall@1
22
HotpotQA
55F1 Score
22
HotpotQA (in-domain)
45.1Accuracy
22
HotpotQA
76.07Precision
22
HotpotQA (test)
65.49Exact Match (EM)
22
HotpotQA Full
86.1C (Correctness)
22
HotpotQA MRQA
80.8F1 Score
22
HotpotQA
21Exact Match (EM)
21
HotpotQA
65.9pass@1 Success Rate
21
HotPotQA
68.08F1
21
HotpotQA v1 (test)
65.9R@2E
21
HotpotQA
0.434Perf
21