Entity Linking on OKE 2016
76.7Macro F1ed base model + att + global
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ed base model + att + globalTraining set=AIDA-train set, Attention mechanism=true, Global context=true, Evaluation platform=Gerbil2018.08 | 76.7 | 78.1 | — | |
| SOTA NLP2020.06 | 76.7 | 78.1 | — | |
| ed base model + attTraining set=AIDA-train set, Attention mechanism=true, Global context=false, Evaluation platform=Gerbil2018.08 | 75.1 | 76.1 | — | |
| REL (2014)Wikipedia Version=20142020.06 | 72 | 72.2 | — | |
| ed base modelTraining set=AIDA-train set, Attention mechanism=false, Global context=false, Evaluation platform=Gerbil2018.08 | 71.9 | 73 | — | |
| KeaEvaluation platform=Gerbil2018.08 | 67.7 | 69.1 | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 67 | 67.3 | — | |
| AGDISTISEvaluation platform=Gerbil2018.08 | 59.6 | 58.8 | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 57.7 | 59.3 | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 57.5 | 58.8 | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 57.4 | 58.3 | — | |
| ED base model + att + global using Stanford NER mentionsMention detection source=Stanford NER2018.08 | 57.1 | 58.4 | — | |
| WAT2018.08 | 55.2 | 56.6 | — | |
| Best baseline2018.08 | 55.2 | 56.6 | — | |
| Kea2018.08 | 54.9 | 55.2 | — | |
| WAT2018.08 | 51.8 | 53.9 | — | |
| WATProtocol=Strong matching2020.06 | 51.8 | 53.9 | — | |
| FOX2018.08 | 50.1 | 51.4 | — | |
| DBpedia Spotlight2018.08 | 49.2 | 49.8 | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 49.2 | 51.6 | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 48.1 | 53.1 | — | |
| base model + att + global2018.08 | 47.8 | 52.7 | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 47.8 | 52.7 | — | |
| base modelAttention=false, Global modeling=false2018.08 | 45 | 47 | — | |
| AIDA2018.08 | 43.3 | 47.2 | — | |
| DBpedia Spotlight2020.06 | 43 | 43.1 | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 41.4 | 43.1 | — | |
| Babelfy2018.08 | 40.1 | 39.7 | — | |
| Entityclassifier.eu2018.08 | 35.7 | 33.6 | — | |
| FREME2018.08 | 23 | 29 | — | |
| WAT2020.06 | 0 | 0 | — | |
| De Cao et al. (2021b)2023.10 | — | — | 50 | |
| Hoffart et al. (2011)2023.10 | — | — | 0 | |
| Kolitsas et al. (2018)2023.10 | — | — | 52.7 | |
| OracleMode=Gold annotations fed to GERBIL2023.10 | — | — | 91.4 | |
| SPEL-baseCandidate set size=500k2023.10 | — | — | 57.4 | |
| SPEL-largeCandidate set size=500k2023.10 | — | — | 56.6 | |
| van Hulst et al. (2020)2023.10 | — | — | 58.8 | |
| Zhang et al. (2022)2023.10 | — | — | 51.3 |