Commonsense Reasoning on Winogrande 2012 (Accuracy)
57.4AccuracyGPT-3
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-3Evaluation Protocol=Zero-shot priming2022.03 | 57.4 | |
| sMLPEvaluation Protocol=Zero-shot priming2022.03 | 54.31 | |
| Switch TransformerEvaluation Protocol=Zero-shot priming2022.03 | 53.43 | |
| HASH LayersEvaluation Protocol=Zero-shot priming2022.03 | 51.7 | |
| GshardEvaluation Protocol=Zero-shot priming2022.03 | 51.068 | |
| Base LayersEvaluation Protocol=Zero-shot priming2022.03 | 50.98 |