MRQA
Benchmarks
TaskDatasetSOTA resultTrendResults
MRQA 2019 (dev)
92.5SQuAD Score
32
MRQA Average across 6 domains
56.8EM
23
MRQA
73.6NewsQA Score
19
MRQA streams (val)
97.49EFR
16
MRQA
62.58HotpotQA EM
14
MRQA Out-of-domain
47.72F1 Score
12
MRQA In-domain
63.63F1 Score
12