# Entity Disambiguation on Entity Disambiguation Suite (AIDA, MSNBC, AQUAINT, ACE2004, CWEB, WIKI)

Source: [Entity Disambiguation on Entity Disambiguation Suite (AIDA, MSNBC, AQUAINT, ACE2004, CWEB, WIKI)](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:22:27.215Z

Evaluation of Entity Disambiguation performance across the combined suite of datasets: AIDA, MSNBC, AQUAINT, ACE2004, CWEB, and WIKI.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Entity Disambiguation |
| Dataset (including any stated split) | Entity Disambiguation Suite (AIDA, MSNBC, AQUAINT, ACE2004, CWEB, WIKI) |
| Metric | AIDA ED Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AIDA ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=AIDA%20ED%20Score>): Higher is better; unit: PERCENT.

- [MSNBC ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=MSNBC%20ED%20Score>): Higher is better; unit: PERCENT.

- [AQUAINT ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=AQUAINT%20ED%20Score>): Higher is better; unit: PERCENT.

- [ACE2004 ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=ACE2004%20ED%20Score>): Higher is better; unit: PERCENT.

- [CWEB ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=CWEB%20ED%20Score>): Higher is better; unit: PERCENT.

- [WIKI ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=WIKI%20ED%20Score>): Higher is better; unit: PERCENT.

- [Overall ED Score](<https://www.sota2.com/research/sota/entity-disambiguation-on-entity-disambiguation-suite-aida-msnbc-aquaint-ace2004-cweb-wiki.md?metric=Overall%20ED%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AIDA ED Score | Result date | Report paper |
| --- | --- | --- | --- |
| BART-large+KILMDU | 86.2 | Not recorded | 68fa6e991e209131cea40fe0 |
| BART-large+KILM | 84.6 | Not recorded | 68fa6e991e209131cea40fe0 |
| CM3-large | 80.1 | Not recorded | 68fa6e991e209131cea40fe0 |
| BART-base+KILM | 80 | Not recorded | 68fa6e991e209131cea40fe0 |
| CM3-medium | 78 | Not recorded | 68fa6e991e209131cea40fe0 |
| BART-large | 34.4 | Not recorded | 68fa6e991e209131cea40fe0 |
| BART-base | 33.8 | Not recorded | 68fa6e991e209131cea40fe0 |
| BART-base+Merge | 28.2 | Not recorded | 68fa6e991e209131cea40fe0 |

### BART-large+KILMDU

AIDA ED Score: 86.2. Result ID: 699049543a6c314849ff7857.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Implementation](<https://github.com/alexa/kilm>)

Recorded evaluation configuration: {"Backbone":"BART-large","Parameters":"406M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### BART-large+KILM

AIDA ED Score: 84.6. Result ID: 699049543a6c314849ff7856.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Implementation](<https://github.com/alexa/kilm>)

Recorded evaluation configuration: {"Backbone":"BART-large","Parameters":"406M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### CM3-large

AIDA ED Score: 80.1. Result ID: 699049543a6c314849ff7851.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba21e209131cea2f773.md>)

Recorded evaluation configuration: {"Backbone":"CM3","Parameters":"13,000M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### BART-base+KILM

AIDA ED Score: 80. Result ID: 699049543a6c314849ff7854.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Implementation](<https://github.com/alexa/kilm>)

Recorded evaluation configuration: {"Backbone":"BART-base","Parameters":"139M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### CM3-medium

AIDA ED Score: 78. Result ID: 699049543a6c314849ff7850.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba21e209131cea2f773.md>)

Recorded evaluation configuration: {"Backbone":"CM3","Parameters":"2,700M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### BART-large

AIDA ED Score: 34.4. Result ID: 699049543a6c314849ff7855.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Backbone":"BART-large","Parameters":"406M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### BART-base

AIDA ED Score: 33.8. Result ID: 699049543a6c314849ff7852.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Backbone":"BART-base","Parameters":"139M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

### BART-base+Merge

AIDA ED Score: 28.2. Result ID: 699049543a6c314849ff7853.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e991e209131cea40fe0.md>)

Recorded evaluation configuration: {"Backbone":"BART-base","Parameters":"139M","Zero-shot evaluation":true}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
