NewsQA
Benchmarks
TaskDatasetSOTA resultTrendResults
NewsQA (dev)
75.5F1 Score
101
NewsQA
80.5F1
67
NewsQA
76.6AUROC
42
NewsQA (test)
73.6F1
40
newsQA
92.9AUC
39
NewsQA MRQA
72.6F1
22
NewsQA trained on SQuAD OOD (test)
52.41F1 Score
20
NewsQA Short-doc
66.43R@1
16
NewsQA
59.7F1 Score
14
NewsQA trained on CausalQA OOD (test)
9.54F1 Score
10
NewsQA (official)
39EM
9
NewsQA
43.55r_pub
7
NewsQA (dev)
94.6Accuracy
7
NewsQA
66.8Score
6
NewsQA
112.36Latency (s)
3
NewsQA
93.3Recall@1
2