Entity Linking on N3-RSS-500
66.6Macro F1SOTA NLP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SOTA NLP2020.06 | 66.6 | 68.6 | — | |
| WAT2020.06 | 62.8 | 63.9 | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 61.7 | 64.1 | — | |
| REL (2014)Wikipedia Version=20142020.06 | 61 | 62.8 | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 48.6 | 46.1 | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 48.4 | 44.6 | — | |
| WAT2018.08 | 47.6 | 46.5 | — | |
| Best baseline2018.08 | 47.6 | 47.5 | — | |
| AIDA2018.08 | 47.3 | 47.5 | — | |
| base modelAttention=false, Global modeling=false2018.08 | 46.5 | 42.8 | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 46.3 | 42.7 | — | |
| base model + att2018.08 | 46 | 40.5 | — | |
| WAT2018.08 | 45.3 | 42.3 | — | |
| WATProtocol=Strong matching2020.06 | 45.3 | 42.3 | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 43.8 | 38.2 | — | |
| DBpedia Spotlight2020.06 | 42.6 | 34.6 | — | |
| FOX2018.08 | 37.7 | 37.2 | — | |
| Babelfy2018.08 | 36.6 | 34.6 | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 36.2 | 35 | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 35.9 | 34.3 | — | |
| DBpedia Spotlight2018.08 | 35.5 | 35.1 | — | |
| FREME2018.08 | 34.6 | 32.4 | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 26.7 | 27.2 | — | |
| Kea2018.08 | 25.9 | 24.7 | — | |
| Entityclassifier.eu2018.08 | 24.5 | 24.1 | — |