Coreference Resolution on WSC (Accuracy & Std Dev)
65.4AccuracyKiC-Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KiC-LargeParams=0.77B, Evaluation=Zero-shot2022.10 | 65.4 | 8.3 | |
| T0-3BParams=3B, Evaluation=Zero-shot2022.10 | 64.4 | 2.7 | |
| T0-11BParams=11B, Evaluation=Zero-shot2022.10 | 64.4 | 6.3 | |
| OPTParams=30B, Evaluation=Zero-shot2022.10 | 63.5 | 13.9 | |
| KiC-SmallParams=0.06B, Evaluation=Zero-shot2022.10 | 63.5 | 3.9 | |
| KiC-BaseParams=0.22B, Evaluation=Zero-shot2022.10 | 63.5 | 1 | |
| T0-BaseParams=0.22B, Evaluation=Zero-shot2022.10 | 61.1 | 5.5 | |
| GPT-NeoXParams=20B, Evaluation=Zero-shot2022.10 | 60.6 | 9.4 | |
| T0-LargeParams=0.77B, Evaluation=Zero-shot2022.10 | 59.1 | 5.9 | |
| BERTParams=0.34B, Evaluation=Zero-shot2022.10 | 53.4 | 7.8 | |
| GPT-NeoParams=2.7B, Evaluation=Zero-shot2022.10 | 45.2 | 8.3 | |
| GPT-JParams=6B, Evaluation=Zero-shot2022.10 | 40.4 | 9.7 | |
| RoBERTaParams=0.35B, Evaluation=Zero-shot2022.10 | 37 | 3.3 |