Machine Reading Comprehension on CMRC Simplified Chinese 2018 (Challenge)
32.3EMPERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PERTModel Size=large2022.03 | 32.3 | 59.2 | |
| MacBERT-largeSize=Large2020.04 | 31.9 | 60.2 | |
| MacBERT-largeModel Size=large2019.06 | 31.9 | 60.2 | |
| MacBERTModel Size=large2022.03 | 31.9 | 60.2 | |
| RoBERTa-wwm-ext largeSize=Large2020.04 | 31.5 | 60.1 | |
| ROBERTa-wwm-ext-largeModel Size=large2019.06 | 31.5 | 60.1 | |
| RoBERTaModel Size=large2022.03 | 31.5 | 60.1 | |
| MacBERT-baseSize=Base2020.04 | 30.2 | 54 | |
| MacBERT-baseModel Size=base2019.06 | 30.2 | 54 | |
| MacBERTModel Size=base2022.03 | 30.2 | 54 | |
| XLNet-midmodel size=mid2020.04 | 29.1 | 55.8 | |
| PERTModel Size=base2022.03 | 28.7 | 55.4 | |
| RoBERTa-wwm-extSize=Base2020.04 | 26.2 | 51 | |
| ROBERTa-wwm-extModel Size=base2019.06 | 26.2 | 51 | |
| RoBERTaModel Size=base2022.03 | 26.2 | 51 | |
| XLNet-basemodel size=base2020.04 | 25 | 51.3 | |
| BERT-wwm-extSize=Base2020.04 | 24 | 47.3 | |
| BERT-wwm-extModel Size=base2019.06 | 24 | 47.3 | |
| BERTModel Size=base2022.03 | 24 | 47.3 | |
| ELECTRA-largeSize=Large2020.04 | 23 | 44.2 | |
| ELECTRA-largeModel Size=large2019.06 | 23 | 44.2 | |
| ELECTRAModel Size=large2022.03 | 23 | 44.2 | |
| ELECTRA-baseSize=Base2020.04 | 22.6 | 45 | |
| ELECTRA-baseModel Size=base2019.06 | 22.6 | 45 | |
| ELECTRAModel Size=base2022.03 | 22.6 | 45 | |
| BERT-wwmSize=Base2020.04 | 21 | 47 | |
| BERT-wwmModel Size=base2019.06 | 21 | 47 | |
| BERTSize=Base2020.04 | 18.6 | 43.3 | |
| BERTmodel size=base2020.04 | 18.6 | 43.3 | |
| BERTModel Size=base2019.06 | 18.6 | 43.3 |