Reading Comprehension on RACE (dev)
88.1AccuracyALBERTxxlarge
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ALBERTxxlargeplus=DUMA2022.03 | 88.1 | — | — | |
| POI-Netbackbone=ALBERTxxlarge2022.03 | 88.1 | 91.3 | 86.3 | |
| ALBERTxxlargererun=true2022.03 | 86.6 | 89.4 | 85.2 | |
| ALBERT xxlargeParameters=235M, Speedup=0.3x2019.09 | 82.3 | — | — | |
| XLNetlarge2022.03 | 80.1 | — | — | |
| ALBERT xlargeParameters=60M, Speedup=0.6x2019.09 | 74.8 | — | — | |
| SegaBERT-largeModel Size=Large2020.04 | 74.5 | — | — | |
| BERT largeParameters=334M, Speedup=1.02019.09 | 73.9 | — | — | |
| BERT-largeModel Size=Large2020.04 | 72.7 | — | — | |
| BERTlarge2022.03 | 72.7 | 76.7 | 71 | |
| POI-Netbackbone=ALBERTbase2022.03 | 72.4 | 76.3 | 70 | |
| ALBERT largeParameters=18M, Speedup=1.7x2019.09 | 68.5 | — | — | |
| BERT baseParameters=108M, Speedup=4.7x2019.09 | 68.2 | — | — | |
| ALBERTbasererun=true2022.03 | 67.9 | 72.3 | 65.7 | |
| BERTbase2022.03 | 64.6 | — | — | |
| ALBERT baseParameters=12M, Speedup=5.6x2019.09 | 64 | — | — |