Question Answering on SQuAD 1.1 & 2.0 (dev)
76SQuAD 1.1 EM/F1 ScoreBERTBASE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BERTBASEdescription=teacher model2026.04 | 76 | 69.5 | 75.2 | |
| MaKD256layers=62026.04 | 74.9 | 69.1 | 74.8 | |
| MINILMv2layers=62026.04 | 73.9 | 68.2 | 73.8 | |
| TinyBERT6layers=62026.04 | 68.2 | 65.8 | 70.2 | |
| DistilBERT6layers=62026.04 | 67.7 | 62.9 | 67.9 |