Natural Language Understanding on SuperGLUE v1 (test)
91.3BoolQ AccT5 + Meena
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| T5 + MeenaModel=T5_11B + Meena2020.06 | 91.3 | 95.8 | 97.6 | 97.4 | 88.3 | 63 | 94.2 | 93.5 | 92.7 | 77.9 | 95.9 | 90.2 | |
| T5Model=T5_11B2020.06 | 91.2 | 93.9 | 96.8 | 94.8 | 88.1 | 63.3 | 94.1 | 93.4 | 92.5 | 76.9 | 93.8 | 89.3 | |
| DeBERTa + SiFTModel=DeBERTa_1.5B + SiFT2020.06 | 90.4 | 94.9 | 97.2 | 96.8 | 88.2 | 63.7 | 94.5 | 94.1 | 93.2 | 76.4 | 95.9 | 89.9 | |
| DeBERTa EnsembleModel=DeBERTa Ensemble2020.06 | 90.4 | 95.7 | 97.6 | 98.4 | 88.2 | 63.7 | 94.5 | 94.1 | 93.2 | 77.5 | 95.9 | 90.3 | |
| HumanModel=Human Baseline2020.06 | 89 | 95.8 | 98.9 | 100 | 81.8 | 51.9 | 91.7 | 91.3 | 93.6 | 80 | 100 | 89.8 | |
| NEXHA-PlusModel=NEXHA-Plus2020.06 | 87.8 | 94.4 | 96 | 93.6 | 84.6 | 55.1 | 90.1 | 89.6 | 89.1 | 74.6 | 93.2 | 86.7 | |
| RoBERTaModel=RoBERTa_large2020.06 | 87.1 | 90.5 | 95.2 | 90.6 | 84.4 | 52.5 | 90.6 | 90 | 88.2 | 69.9 | 89 | 84.6 |