Coreference Resolution on Winogrande XL
60.5AccuracyT0-11B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| T0-11BParams=11B, Evaluation=Zero-shot2022.10 | 60.5 | 2.5 | |
| KiC-LargeParams=0.77B, Evaluation=Zero-shot2022.10 | 55.3 | 2.4 | |
| KiC-SmallParams=0.06B, Evaluation=Zero-shot2022.10 | 51.1 | 0.6 | |
| GPT-NeoParams=2.7B, Evaluation=Zero-shot2022.10 | 50.8 | 0.9 | |
| T0-BaseParams=0.22B, Evaluation=Zero-shot2022.10 | 50.6 | 0.9 | |
| T0-LargeParams=0.77B, Evaluation=Zero-shot2022.10 | 50.5 | 0.3 | |
| T0-3BParams=3B, Evaluation=Zero-shot2022.10 | 50.5 | 1.2 | |
| KiC-BaseParams=0.22B, Evaluation=Zero-shot2022.10 | 50 | 0.4 | |
| BERTParams=0.34B, Evaluation=Zero-shot2022.10 | 49.5 | 1 | |
| RoBERTaParams=0.35B, Evaluation=Zero-shot2022.10 | 48.9 | 0.7 | |
| GPT-NeoXParams=20B, Evaluation=Zero-shot2022.10 | 48.9 | 0.8 | |
| GPT-JParams=6B, Evaluation=Zero-shot2022.10 | 48.5 | 0.8 | |
| OPTParams=30B, Evaluation=Zero-shot2022.10 | 48.4 | 0.3 |