Entity Disambiguation on Entity Disambiguation Suite (AIDA, MSNBC, AQUAINT, ACE2004, CWEB, WIKI)
86.2AIDA ED ScoreBART-large+KILMDU
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| BART-large+KILMDUBackbone=BART-large, Parameters=406M, Zero-shot evaluation=true2023.02 | 86.2 | 87.8 | 84.3 | 83.7 | 68.4 | 79.9 | 81.7 | |
| BART-large+KILMBackbone=BART-large, Parameters=406M, Zero-shot evaluation=true2023.02 | 84.6 | 86.4 | 79.8 | 80.9 | 66.1 | 75.4 | 78.9 | |
| CM3-largeBackbone=CM3, Parameters=13,000M, Zero-shot evaluation=true2023.02 | 80.1 | 80.8 | 77.7 | 82.8 | 72.4 | 80.2 | 79 | |
| BART-base+KILMBackbone=BART-base, Parameters=139M, Zero-shot evaluation=true2023.02 | 80 | 83.7 | 74.7 | 78.2 | 63.7 | 71.3 | 75.3 | |
| CM3-mediumBackbone=CM3, Parameters=2,700M, Zero-shot evaluation=true2023.02 | 78 | 80.1 | 75.4 | 81.4 | 68.5 | 76.2 | 76.6 | |
| BART-largeBackbone=BART-large, Parameters=406M, Zero-shot evaluation=true2023.02 | 34.4 | 58.8 | 42.3 | 38.9 | 36.9 | 46.5 | 43 | |
| BART-baseBackbone=BART-base, Parameters=139M, Zero-shot evaluation=true2023.02 | 33.8 | 57.6 | 44.6 | 37.8 | 36.4 | 46.1 | 42.7 | |
| BART-base+MergeBackbone=BART-base, Parameters=139M, Zero-shot evaluation=true2023.02 | 28.2 | 43.3 | 27.1 | 19.5 | 27.3 | 39.9 | 30.9 |