# Coreference Resolution on WSC (Accuracy & Std Dev)

Source: [Coreference Resolution on WSC (Accuracy & Std Dev)](<https://www.sota2.com/research/sota/coreference-resolution-on-wsc-accuracy-and-std-dev>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:28:48.290Z

Evaluation of Coreference Resolution performance on the WSC dataset, reporting Accuracy and Standard Deviation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Coreference Resolution |
| Dataset (including any stated split) | WSC |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/coreference-resolution-on-wsc-accuracy-and-std-dev.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Std Dev](<https://www.sota2.com/research/sota/coreference-resolution-on-wsc-accuracy-and-std-dev.md?metric=Std%20Dev>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| KiC-Large | 65.4 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-3B | 64.4 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-11B | 64.4 | Not recorded | 68fa6ee81e209131cea42cc4 |
| OPT | 63.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| KiC-Small | 63.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| KiC-Base | 63.5 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-Base | 61.1 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-NeoX | 60.6 | Not recorded | 68fa6ee81e209131cea42cc4 |
| T0-Large | 59.1 | Not recorded | 68fa6ee81e209131cea42cc4 |
| BERT | 53.4 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-Neo | 45.2 | Not recorded | 68fa6ee81e209131cea42cc4 |
| GPT-J | 40.4 | Not recorded | 68fa6ee81e209131cea42cc4 |
| RoBERTa | 37 | Not recorded | 68fa6ee81e209131cea42cc4 |

### KiC-Large

Accuracy: 65.4. Result ID: 699083733a6c314849011a92.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.77B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-3B

Accuracy: 64.4. Result ID: 699083733a6c314849011a8e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"3B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-11B

Accuracy: 64.4. Result ID: 699083733a6c314849011a8f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"11B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### OPT

Accuracy: 63.5. Result ID: 699083733a6c314849011a8a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cda1e209131cea36474.md>)

[Implementation](<https://github.com/facebookresearch/metaseq>)

Recorded evaluation configuration: {"Params":"30B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KiC-Small

Accuracy: 63.5. Result ID: 699083733a6c314849011a90.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.06B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### KiC-Base

Accuracy: 63.5. Result ID: 699083733a6c314849011a91.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"0.22B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-Base

Accuracy: 61.1. Result ID: 699083733a6c314849011a8c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"0.22B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-NeoX

Accuracy: 60.6. Result ID: 699083733a6c314849011a8b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c531e209131cea33449.md>)

[Implementation](<https://github.com/EleutherAI/gpt-neox>)

Recorded evaluation configuration: {"Params":"20B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### T0-Large

Accuracy: 59.1. Result ID: 699083733a6c314849011a8d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c131e209131cea31f71.md>)

Recorded evaluation configuration: {"Params":"0.77B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### BERT

Accuracy: 53.4. Result ID: 699083733a6c314849011a86.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Params":"0.34B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-Neo

Accuracy: 45.2. Result ID: 699083733a6c314849011a88.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"2.7B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### GPT-J

Accuracy: 40.4. Result ID: 699083733a6c314849011a89.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

Recorded evaluation configuration: {"Params":"6B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

### RoBERTa

Accuracy: 37. Result ID: 699083733a6c314849011a87.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ee81e209131cea42cc4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Params":"0.35B","Evaluation":"Zero-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
