PopQA
Benchmarks
TaskDatasetSOTA resultTrendResults
PopQA
73.6EM
200
PopQA
68.4Accuracy
186
PopQA
87.12Accuracy
158
PopQA
64.2Exact Match
133
PopQA (test)
77.2Accuracy
122
PopQA
56.6EM
112
PopQA
96.18AUC
97
PopQA
52.7Score
86
PopQA 500 randomly sampled queries (test)
0.871AUROC
70
PopQA
52Exact Match (EM)
58
PopQA
35.3Accuracy
56
PopQA
45.2EM
51
PopQA
67.85F1 Score
45
PopQA (test)
51.5Accuracy
43
PopQA CF-RAG
92.54CF
36
PopQA (test)
65.24RAG F1
36
popQA
90.28ACCL
32
PopQA
59.9F1 Score
30
PopQA
47.82EM (%)
27
PopQA
46.1EM
27
PopQA (test)
49.3EM
27
PopQA
56.3F1
26
PopQA
70.7Accuracy (Acc)
26
PopQA (test)
66.06AUARC
25
PopQA
81.6Abstain Accuracy
25