# Coreference Resolution on Winogrande XL

Source: [Coreference Resolution on Winogrande XL](<https://www.sota2.com/research/sota/coreference-resolution-on-winogrande-xl>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:28:48.311Z

Evaluation of Coreference Resolution performance on the Winogrande XL dataset, typically measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Coreference Resolution |
| Dataset (including any stated split) | Winogrande XL |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/coreference-resolution-on-winogrande-xl.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Standard Deviation](<https://www.sota2.com/research/sota/coreference-resolution-on-winogrande-xl.md?metric=Standard%20Deviation>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| T0-11B | 60.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| KiC-Large | 55.3 | Not recorded | 68fa6ee81e209131cea42cc4 |
| KiC-Small | 51.1 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-Neo | 50.8 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-Base | 50.6 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-Large | 50.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-3B | 50.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| KiC-Base | 50 | Not recorded | 68fa6ee81e209131cea42cc4 |
| BERT | 49.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| RoBERTa | 48.9 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-NeoX | 48.9 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-J | 48.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| OPT | 48.4 | Not recorded | 68fa6ee81e209131cea42cc4 |

### T0-11B

Accuracy: 60.5. Result ID: 699083733a6c314849011a9c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"11B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KiC-Large

Accuracy: 55.3. Result ID: 699083733a6c314849011a9f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.77B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KiC-Small

Accuracy: 51.1. Result ID: 699083733a6c314849011a9d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.06B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-Neo

Accuracy: 50.8. Result ID: 699083733a6c314849011a95.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"2.7B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-Base

Accuracy: 50.6. Result ID: 699083733a6c314849011a99.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"0.22B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-Large

Accuracy: 50.5. Result ID: 699083733a6c314849011a9a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"0.77B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-3B

Accuracy: 50.5. Result ID: 699083733a6c314849011a9b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"3B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KiC-Base

Accuracy: 50. Result ID: 699083733a6c314849011a9e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.22B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### BERT

Accuracy: 49.5. Result ID: 699083733a6c314849011a93.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Params":"0.34B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### RoBERTa

Accuracy: 48.9. Result ID: 699083733a6c314849011a94.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Params":"0.35B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-NeoX

Accuracy: 48.9. Result ID: 699083733a6c314849011a98.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c531e209131cea33449.md>)

[Implementation](<https://github.com/EleutherAI/gpt-neox>)

Recorded evaluation configuration: {"Params":"20B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-J

Accuracy: 48.5. Result ID: 699083733a6c314849011a96.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"6B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### OPT

Accuracy: 48.4. Result ID: 699083733a6c314849011a97.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cda1e209131cea36474.md>)

[Implementation](<https://github.com/facebookresearch/metaseq>)

Recorded evaluation configuration: {"Params":"30B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
