Entity Linking on Derczynski
70.4Macro F1WAT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| WAT2020.06 | 70.4 | 69.5 | — | |
| SOTA NLP2020.06 | 65.3 | 65.4 | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 62.3 | 62 | — | |
| REL (2014)Wikipedia Version=20142020.06 | 61.9 | 62.1 | — | |
| DBpedia Spotlight2020.06 | 50.3 | 43.3 | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 50.2 | 44.3 | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 49.3 | 44.4 | — | |
| base model + att2018.08 | 47.9 | 42.3 | — | |
| WAT2018.08 | 47.1 | 43.6 | — | |
| Best baseline2018.08 | 47.1 | 43.6 | — | |
| base modelAttention=false, Global modeling=false2018.08 | 44.9 | 40.1 | — | |
| WAT2018.08 | 44.4 | 38 | — | |
| WATProtocol=Strong matching2020.06 | 44.4 | 38 | — | |
| DBpedia Spotlight2018.08 | 44 | 41.5 | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 43.8 | 34.9 | — | |
| FOX2018.08 | 43.4 | 41.5 | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 43.2 | 34.1 | — | |
| AIDA2018.08 | 41.5 | 34.8 | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 38.1 | 41.2 | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 38 | 41.1 | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 33.7 | 32.2 | — | |
| Kea2018.08 | 33.2 | 29.2 | — | |
| Babelfy2018.08 | 32.3 | 34.3 | — | |
| FREME2018.08 | 31.8 | 20.4 | — | |
| Entityclassifier.eu2018.08 | 18.1 | 19.3 | — | |
| De Cao et al. (2021b)2023.10 | — | — | 54.1 | |
| Hoffart et al. (2011)2023.10 | — | — | 32.6 | |
| Kolitsas et al. (2018)2023.10 | — | — | 34.1 | |
| OracleMode=Gold annotations fed to GERBIL2023.10 | — | — | 91.4 | |
| SPEL-baseCandidate set size=500k2023.10 | — | — | 50.7 | |
| SPEL-largeCandidate set size=500k2023.10 | — | — | 59.1 | |
| van Hulst et al. (2020)2023.10 | — | — | 41.2 | |
| Zhang et al. (2022)2023.10 | — | — | 52.9 |