Sentence Pair Matching (SPM) (dev)
90.9AccuracyERNIE 2.0 (B)
Evaluation results
| Method | Links | |
|---|---|---|
| ERNIE 2.0 (B)Backbone Scale=Base2019.11 | 90.9 | |
| ERNIE 2.0 (L)Backbone Scale=Large2019.11 | 90.9 | |
| NEZHA-wwm (L)Whole Word Masking=true, Backbone Scale=Large2019.11 | 90.87 | |
| ZEN (P)Initialization=Pre-trained, Backbone Scale=Base2019.11 | 90.2 | |
| NEZHA (L)Backbone Scale=Large2019.11 | 90.18 | |
| NEZHA (B)Backbone Scale=Base2019.11 | 89.98 | |
| NEZHA-WWM (B)Whole Word Masking=true, Backbone Scale=Base2019.11 | 89.85 | |
| ERNIE 1.0Backbone Scale=Base2019.11 | 89.7 | |
| BERT-WWMWhole Word Masking=true, Backbone Scale=Base2019.11 | 89.2 | |
| BERT (P)Initialization=Pre-trained, Backbone Scale=Base2019.11 | 88.5 | |
| ZEN (R)Initialization=Random, Backbone Scale=Base2019.11 | 88.1 | |
| BERT (R)Initialization=Random, Backbone Scale=Base2019.11 | 87.22 |