RACE
Benchmarks
TaskDatasetSOTA resultTrendResults
RACE
88.1Accuracy
7
RACE weak pool (val)
31Exact Match
6
Race Japanese
3.22KEI Score
6
Race English
3.12KEI Score
6
RACE (val)
90.2Accuracy
6
RACE (test)
39.81BLEU-1
6
RACE
30MRR
6
RACE (test)
85.54F1
5
RACE
0.623Hard Score
5
RACE
89.5Accuracy
5
RACENum (unsupervised)
52.53Accuracy (RACE-M)
4
RACE middle
87.6Accuracy
4
RACE
89.69Accuracy
3
RACE (test)
1.95Fluency
3
RACE
50.36Score
2
RACE
7.46Training Time (h)
2
RACE-Audio (test)
—Accuracy (Sub-task 1)
0