HotpotQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
HotpotQA in-domain
46.3EM
53
HotpotQA
51.8Reliability Score (RS)
52
HotpotQA
86.7Accuracy
51
HotpotQA
55Exact Match (EM)
50
HotpotQA
90.38Accuracy
50
HotpotQA
75.97F1
48
HotpotQA fullwiki (test)
67.5Answer EM
48
HotpotQA
40.9F1 Score
47
HotpotQA
41.02F1 Score
47
HotpotQA PoisonedRAG (test)
17Abstention Rate (ASR)
45
HotpotQA Clean (test)
87Accuracy
45
HotpotQA
58.98F1 Score
45
HotpotQA distractor (dev)
84.2Answer F1
45
HotpotQA
85.9Recall@2
44
HotpotQA (dev)
81Answer F1
43
HotpotQA
100ASR
42
HotpotQA
89.5Recall
42
HotpotQA
91.3Accuracy
41
HotpotQA
96.1Attack Success Rate (ASR)
41
HotpotQA
0.654F1 Score
41
HotpotQA
100Recall@1
40
HotPotQA
59.6F1
39
HotpotQA (test)
57.2EM
39
HotpotQA (test)
0.976AuROC
38
HotpotQA fullwiki setting (dev)
81.5Answer F1
38