Commonsense Reasoning on Winogrande 1.0 (Partitions XS, S, M, L, XL)
78.8Accuracy (XS)UnifiedQA-T5
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| UnifiedQA-T5training_mode=fine-tuning, backbone=T52020.05 | 78.8 | 83.4 | 86.9 | 85.5 | 89.4 | 85.7 | |
| T5training_mode=fine-tuning2020.05 | 75.6 | 79.8 | 86.4 | 90.3 | 90.2 | 84.8 | |
| UnifiedQA-BARTtraining_mode=fine-tuning, backbone=BART-large2020.05 | 56 | 59.5 | 61.6 | 68.6 | 73.3 | 63.6 | |
| RoBERTaNote=Previous best published2020.05 | 55.4 | 62.4 | 66.7 | 74.2 | 78.2 | 67.5 | |
| BART-largetraining_mode=fine-tuning2020.05 | 54.2 | 57.8 | 59.7 | 68.9 | 72 | 62.4 |