Textual Entailment on FewGLUE CB (32 examples, dev)
92.4F1 ScoreiPET (ALBERT)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| iPET (ALBERT)Backbone=ALBERT, Training protocol=iPET2021.01 | 92.4 | 92.9 | |
| WARPinit (ALBERT)Backbone=ALBERT, Training protocol=WARP2021.01 | 84 | 87.5 | |
| PET (ALBERT)Backbone=ALBERT, Training protocol=PET2021.01 | 59.4 | 85.1 | |
| GPT-3Parameters=170B2021.01 | 57.2 | 82.1 | |
| GPT-3 MedModel size=Medium2021.01 | 40.4 | 58.9 | |
| GPT-3 SmallModel size=Small2021.01 | 26.1 | 42.9 |