XTREME QA
Benchmarks
TaskDatasetSOTA resultTrendResults
XTREME QA Average across all orders (test)
59.41EM
16
XTREME QA Order 6 - Long Sequence (test)
0.609EM
16
XTREME QA Order 5 - Long Sequence (test)
60.92EM
16
XTREME QA Order 4 - Long Sequence (test)
60.84EM
16
XTREME QA Order 3 - Short Sequence (test)
58EM
16
XTREME QA Order 2 - Short Sequence (test)
57.99EM
16
XTREME QA Order 1 - Short Sequence (test)
57.85EM
16