Entity Linking on OKE 2015
73.2Macro F1SOTA NLP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SOTA NLP2020.06 | 73.2 | 74 | — | |
| REL (2014)Wikipedia Version=20142020.06 | 65.5 | 65.8 | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 65.3 | 68.9 | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 64 | 64.3 | — | |
| WAT2020.06 | 62.2 | 64.9 | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 61.8 | 63.1 | — | |
| AIDA2018.08 | 61.7 | 65.8 | — | |
| Best baseline2018.08 | 61.7 | 65.8 | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 61.5 | 64.8 | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 59.4 | 64.6 | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 59 | 63 | — | |
| AIDA2018.08 | 58.7 | 63.1 | — | |
| WAT2018.08 | 58.4 | 60.7 | — | |
| base model + att + global2018.08 | 56.6 | 61.9 | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 56.6 | 61.9 | — | |
| FOX2018.08 | 56.4 | 58.7 | — | |
| base modelAttention=false, Global modeling=false2018.08 | 56.2 | 60.1 | — | |
| FOX2018.08 | 53.9 | 56.8 | — | |
| Kea2018.08 | 53.9 | 54.4 | — | |
| WATProtocol=Strong matching2020.06 | 53.2 | 56.4 | — | |
| DBpedia Spotlight2018.08 | 49.6 | 52.2 | — | |
| Babelfy2018.08 | 42.8 | 45.7 | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 42 | 44.4 | — | |
| Entityclassifier.eu2018.08 | 32.7 | 33 | — | |
| DBpedia Spotlight2020.06 | 30.4 | 35.8 | — | |
| FREME2018.08 | 26.8 | 32.7 | — | |
| De Cao et al. (2021b)2023.10 | — | — | 56.1 | |
| Hoffart et al. (2011)2023.10 | — | — | 63.1 | |
| Kolitsas et al. (2018)2023.10 | — | — | 61.9 | |
| OracleMode=Gold annotations fed to GERBIL2023.10 | — | — | 88.2 | |
| SPEL-baseCandidate set size=500k2023.10 | — | — | 55.9 | |
| SPEL-largeCandidate set size=500k2023.10 | — | — | 59.5 | |
| van Hulst et al. (2020)2023.10 | — | — | 64.8 | |
| Zhang et al. (2022)2023.10 | — | — | 61.1 |