Machine Reading Comprehension on CMRC 2018 (dev)
72.2EMPERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PERTModel Size=large2022.11 | 72.2 | 89.4 | |
| ERNIE 2.0Model Version=ERNIE 2.0, Model Scale=LARGE2019.07 | 71.5 | 89.9 | |
| LERTModel Size=large2022.11 | 71.2 | 89.5 | |
| MacBERT-largeSize=Large2020.04 | 70.7 | 88.9 | |
| ChineseBERTModel Size=Large, Pre-training Data=Standard2021.06 | 70.7 | — | |
| MacBERTModel Size=large2022.11 | 70.7 | 88.9 | |
| RoBERTaModel Size=Large, Pre-training Data=Extended2021.06 | 70.59 | — | |
| LERTModel Size=base2022.11 | 69.2 | 88.1 | |
| ERNIE 2.0Model Version=ERNIE 2.0, Model Scale=BASE2019.07 | 69.1 | 88.6 | |
| ELECTRA-largeSize=Large2020.04 | 69.1 | 85.2 | |
| ELECTRAModel Size=large2022.11 | 69.1 | 85.2 | |
| MacBERT-baseSize=Base2020.04 | 68.5 | 87.9 | |
| RoBERTa-wwm-ext largeSize=Large2020.04 | 68.5 | 88.4 | |
| MacBERTModel Size=base2022.11 | 68.5 | 87.9 | |
| PERTModel Size=base2022.11 | 68.5 | 87.2 | |
| RoBERTaModel Size=large2022.11 | 68.5 | 88.4 | |
| ELECTRA-baseSize=Base2020.04 | 68.4 | 84.8 | |
| ELECTRAModel Size=base2022.11 | 68.4 | 84.8 | |
| ChineseBERTModel Size=Base, Pre-training Data=Standard2021.06 | 67.95 | — | |
| RoBERTaModel Size=Base, Pre-training Data=Extended2021.06 | 67.89 | — | |
| RoBERTa-wwm-extSize=Base2020.04 | 67.4 | 87.2 | |
| RoBERTaModel Size=base2022.11 | 67.4 | 87.2 | |
| BERT-wwm-extSize=Base2020.04 | 67.1 | 85.7 | |
| BERTModel Size=base2022.11 | 67.1 | 85.7 | |
| BERTModel Size=Base, Pre-training Data=Extended2021.06 | 66.96 | — | |
| ERNIEModel Size=Base, Pre-training Data=Standard2021.06 | 66.89 | — | |
| XLNet-midmodel size=mid2020.04 | 66.8 | 88.4 | |
| BERTModel Size=Base, Pre-training Data=Standard2021.06 | 66.77 | — | |
| BERTModel Version=BERT, Model Scale=BASE2019.07 | 66.3 | 85.9 | |
| BERT-wwmSize=Base2020.04 | 66.3 | 85.6 | |
| BERTSize=Base2020.04 | 65.5 | 84.5 | |
| BERTmodel size=base2020.04 | 65.5 | 84.5 | |
| XLNet-basemodel size=base2020.04 | 65.2 | 86.9 | |
| ERNIE 1.0Model Version=ERNIE 1.0, Model Scale=BASE2019.07 | 65.1 | 85.1 |