Machine Reading Comprehension on DRCD (dev)
91.6EMLERT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LERTModel Size=large2022.11 | 91.6 | 96.1 | |
| MacBERT-largemodel_size=large2020.04 | 91.2 | 95.6 | |
| MacBERT-largeModel Size=large2019.06 | 91.2 | 95.6 | |
| MacBERTModel Size=large2022.03 | 91.2 | 95.6 | |
| MacBERTModel Size=large2022.11 | 91.2 | 95.6 | |
| PERTModel Size=large2022.03 | 90.9 | 95.5 | |
| PERTModel Size=large2022.11 | 90.9 | 95.5 | |
| LERTModel Size=base2022.11 | 90.5 | 95.1 | |
| ERNIE 2.0Model Version=ERNIE 2.0, Model Scale=LARGE2019.07 | 89.7 | 94.7 | |
| RoBERTa-wwm-ext-Lmodel_size=large2020.04 | 89.6 | 94.8 | |
| ROBERTa-wwm-ext-largeModel Size=large2019.06 | 89.6 | 94.8 | |
| RoBERTaModel Size=large2022.03 | 89.6 | 94.8 | |
| RoBERTaModel Size=large2022.11 | 89.6 | 94.8 | |
| PERTModel Size=base2022.03 | 89.5 | 93.9 | |
| PERTModel Size=base2022.11 | 89.5 | 93.9 | |
| MacBERT-basemodel_size=base2020.04 | 89.4 | 94.3 | |
| MacBERT-baseModel Size=base2019.06 | 89.4 | 94.3 | |
| MacBERTModel Size=base2022.03 | 89.4 | 94.3 | |
| MacBERTModel Size=base2022.11 | 89.4 | 94.3 | |
| ELECTRA-largemodel_size=large2020.04 | 88.8 | 93.3 | |
| ELECTRA-largeModel Size=large2019.06 | 88.8 | 93.3 | |
| ELECTRAModel Size=large2022.03 | 88.8 | 93.3 | |
| ELECTRAModel Size=large2022.11 | 88.8 | 93.3 | |
| ERNIE 2.0Model Version=ERNIE 2.0, Model Scale=BASE2019.07 | 88.5 | 93.8 | |
| ELECTRA-basemodel_size=base2020.04 | 87.5 | 92.5 | |
| ELECTRA-baseModel Size=base2019.06 | 87.5 | 92.5 | |
| ELECTRAModel Size=base2022.03 | 87.5 | 92.5 | |
| ELECTRAModel Size=base2022.11 | 87.5 | 92.5 | |
| RoBERTa-wwm-extmodel_size=base2020.04 | 86.6 | 92.5 | |
| ROBERTa-wwm-extModel Size=base2019.06 | 86.6 | 92.5 | |
| RoBERTaModel Size=base2022.03 | 86.6 | 92.5 | |
| RoBERTaModel Size=base2022.11 | 86.6 | 92.5 | |
| BERTModel Version=BERT, Model Scale=BASE2019.07 | 85.7 | 91.6 | |
| XLNetModel size=mid2020.04 | 85 | 91.2 | |
| BERT-wwm-ext2020.04 | 85 | 91.2 | |
| BERT-wwm-extModel Size=base2019.06 | 85 | 91.2 | |
| BERTModel Size=base2022.03 | 85 | 91.2 | |
| BERTModel Size=base2022.11 | 85 | 91.2 | |
| ERNIE 1.0Model Version=ERNIE 1.0, Model Scale=BASE2019.07 | 84.6 | 90.9 | |
| BERT-wwm2020.04 | 84.3 | 90.5 | |
| BERT-wwmModel Size=base2019.06 | 84.3 | 90.5 | |
| XLNetModel size=base2020.04 | 83.8 | 92.3 | |
| BERT2020.04 | 83.1 | 89.9 | |
| BERT2020.04 | 83.1 | 89.9 | |
| BERTModel Size=base2019.06 | 83.1 | 89.9 |