Entity Linking on KORE50
61.9Macro F1REL (2014)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| REL (2014)Wikipedia Version=20142020.06 | 61.9 | 64.6 | — | — | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 60.1 | 61.6 | — | — | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 54.4 | 54 | — | — | — | |
| Babelfy2018.08 | 53 | 56.6 | — | — | — | |
| Best baseline2018.08 | 53 | 58.6 | — | — | — | |
| Babelfy2018.08 | 52.5 | 55.9 | — | — | — | |
| WAT2020.06 | 52.4 | 62.2 | — | — | — | |
| SOTA NLP2020.06 | 52.4 | 60.8 | — | — | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 50.1 | 50.7 | — | — | — | |
| AIDA2018.08 | 49.6 | 55.4 | — | — | — | |
| DBpedia Spotlight2020.06 | 48.7 | 52.3 | — | — | — | |
| Kea2018.08 | 46.5 | 50.5 | — | — | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 41.9 | 47.8 | — | — | — | |
| ED base model + att + global using Stanford NER mentions2018.08 | 40.3 | 46 | — | — | — | |
| WAT2018.08 | 39.9 | 52.2 | — | — | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 38 | 45.1 | — | — | — | |
| WATProtocol=Strong matching2020.06 | 37.3 | 49.6 | — | — | — | |
| base modelAttention=false, Global modeling=false2018.08 | 36.9 | 44.7 | — | — | — | |
| AIDA2018.08 | 34.8 | 52.9 | — | — | — | |
| FOX2018.08 | 30.1 | 32.9 | — | — | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 29.4 | 34.9 | — | — | — | |
| DBpedia Spotlight2018.08 | 28.8 | 35.4 | — | — | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 28.2 | 38.3 | — | — | — | |
| Entityclassifier.eu2018.08 | 27.1 | 30.1 | — | — | — | |
| base model + att + global2018.08 | 26.2 | 35.2 | — | — | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 26.2 | 35.2 | — | — | — | |
| FREME2018.08 | 13.3 | 15.5 | — | — | — | |
| BOOTLEG2020.10 | — | — | 86 | 85.4 | 85.7 | |
| Hu et al. [24]2020.10 | — | — | 80 | 79.8 | 79.9 |