CausalQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CausalQA Industrial domain (test)
85.84F1 Score
15
CausalQA Technology Setup 1 (test)
85.54F1
15
CausalQA Consumer Setup 1 (test)
85.84F1 Score
15
CausalQA Technology domain (test)
79F1 Score
12
CausalQA Consumer domain (test)
80.55F1
12
CausalQA Industrial Setup 1 (test)
80.7F1
12
CausalQA trained on NewsQA OOD (test)
51.64F1
10
CausalQA trained on SQuAD OOD (test)
66.86F1 Score
10
CausalQA HotpotQA
15.4Hit@1
6
CausalQA SQuAD v2.0
29.3Hit@1
6
CausalQA Natural Questions
15.7Hit@1
6
CausalQA MS MARCO
21.3Hit@1
6
CausalQA causal questions only
49.3Accuracy
2
CausalQA (test)
85.53F1 Score
2
CausalQA (dev)
85.4F1 Score
2