Pronoun Resolution on WinoGrande (test)
58.68Single AccuracyALBERT-xxlarge
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ALBERT-xxlargeSetup=Zero-shot2021.04 | 58.68 | 20.83 | |
| RoBERTa-baseSetup=Zero-shot2021.04 | 56.25 | 14.58 | |
| BERT-largeSetup=Zero-shot2021.04 | 55.56 | 12.5 | |
| RoBERTa-largeSetup=Zero-shot2021.04 | 54.86 | 12.5 | |
| BERT-baseSetup=Zero-shot2021.04 | 53.12 | 11.11 | |
| ALBERT-baseSetup=Zero-shot2021.04 | 52.78 | 7.64 | |
| randomSetup=Zero-shot2021.04 | 50 | 25 |