Entity Linking on N3-Reuters-128
63.4Macro F1SOTA NLP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SOTA NLP2020.06 | 63.4 | 67.3 | |
| REL (2014)Wikipedia Version=20142020.06 | 59.8 | 64.9 | |
| WAT2020.06 | 59.2 | 63.1 | |
| REL (2019)Wikipedia Version=2019-072020.06 | 58.2 | 64.9 | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 54.9 | 56.9 | |
| WAT2018.08 | 54.4 | 58.3 | |
| Best baseline2018.08 | 54.4 | 58.3 | |
| FOX2018.08 | 53.8 | 55.2 | |
| FOX2018.08 | 52.4 | 53.3 | |
| base model + attAttention=true, Global modeling=false2018.08 | 51 | 54.7 | |
| base modelAttention=false, Global modeling=false2018.08 | 48.7 | 51.4 | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 47 | 53.2 | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 46.8 | 49.7 | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 45.7 | 49.9 | |
| base model + att + global2018.08 | 45.4 | 50.3 | |
| SOTA NLPProtocol=Strong matching2020.06 | 45.4 | 50.3 | |
| WATProtocol=Strong matching2020.06 | 45 | 49.2 | |
| AIDA2018.08 | 44.7 | 48.5 | |
| DBpedia Spotlight2020.06 | 41.8 | 43.4 | |
| DBpedia Spotlight2018.08 | 36 | 38 | |
| Entityclassifier.eu2018.08 | 31.8 | 35.3 | |
| Babelfy2018.08 | 29.8 | 33.6 | |
| FREME2018.08 | 28.2 | 33.5 | |
| Kea2018.08 | 22.1 | 22.4 | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 21.5 | 24.8 |