Question Answering on MultiRC SuperGLUE (dev)
68.67AccuracyAD-KD
Evaluation Results
| Method | Links | |
|---|---|---|
| AD-KD#Params=66M2023.05 | 68.67 | |
| BERT_base (Teacher)#Params=110M2023.05 | 68.53 | |
| MGSKD#Params=66M2023.05 | 68.29 | |
| Vanilla KD#Params=66M2023.05 | 67.7 |
Loading the SOTA2 catalog…