Entity Linking on MSNBC
93.9Micro F1Phong and Titov
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Phong and Titov2019.02 | 93.9 | — | — | — | |
| Ganea and Hofmann2019.02 | 93.7 | — | — | — | |
| RLEL2019.02 | 92.8 | — | — | — | |
| Guo and Barbosa2019.02 | 92 | — | — | — | |
| Cheng and Roth2019.02 | 90 | — | — | — | |
| REL (2014)Wikipedia Version=20142020.06 | 88.5 | 89.6 | — | — | |
| SOTA NLP2020.06 | 86.2 | 88.5 | — | — | |
| REL (2019)Wikipedia Version=2019-072020.06 | 85.8 | 86.3 | — | — | |
| Hoffart and Johannes2019.02 | 79 | — | — | — | |
| WAT2020.06 | 78.8 | 79.7 | — | — | |
| Milne and Witten2019.02 | 78 | — | — | — | |
| Ratinov and Lev2019.02 | 75 | — | — | — | |
| ED base model + att + globalAttention=true, Global modeling=true, Mention detection source=Stanford NER mentions2018.08 | 74.8 | 74.7 | — | — | |
| base model + att + globalAttention=true, Global modeling=true2018.08 | 74.7 | 75.7 | — | — | |
| REL (2014)Protocol=Strong matching, Reference KB=Wikipedia 2014, Embeddings=[8]2020.06 | 74.4 | 73.2 | — | — | |
| base model + attAttention=true, Global modeling=false2018.08 | 72.6 | 72.6 | — | — | |
| base model + att + global2018.08 | 72.4 | 73 | — | — | |
| SOTA NLPProtocol=Strong matching2020.06 | 72.4 | 73 | — | — | |
| REL (2019)Protocol=Strong matching, Reference KB=Wikipedia 2019-07, Embeddings=Wikipedia2Vec2020.06 | 72.4 | 71.1 | — | — | |
| ED base model + att + global using Stanford NER mentionsMention detection source=Stanford NER2018.08 | 71 | 71.1 | — | — | |
| WAT2018.08 | 68.9 | 66.7 | — | — | |
| Best baseline2018.08 | 68.9 | 66.7 | — | — | |
| base modelAttention=false, Global modeling=false2018.08 | 68.8 | 67.3 | — | — | |
| AIDA2018.08 | 68.1 | 66 | — | — | |
| AIDA2018.08 | 65.1 | 62.7 | — | — | |
| WATProtocol=Strong matching2020.06 | 64.5 | 62.6 | — | — | |
| DBpedia Spotlight2018.08 | 49.2 | 49.6 | — | — | |
| Entityclassifier.eu2018.08 | 48.9 | 47.2 | — | — | |
| Babelfy2018.08 | 44.9 | 40.2 | — | — | |
| DBpedia Spotlight2020.06 | 42.1 | 43.6 | — | — | |
| DBpedia SpotlightProtocol=Strong matching2020.06 | 40.6 | 42.4 | — | — | |
| Kea2018.08 | 36.3 | 35 | — | — | |
| FREME2018.08 | 22.6 | 17.6 | — | — | |
| FOX2018.08 | 21.2 | 26.3 | — | — | |
| FREME2018.08 | 19.9 | 15.8 | — | — | |
| FOX2018.08 | 8.3 | 11.2 | — | — | |
| Cheng and RothSupervision Strategy=Wikipedia2019.06 | — | — | 90 | 81.38 | |
| Ganea and HofmannSupervision Strategy=Fully-supervised (Wiki + AIDA CoNLL train)2019.06 | — | — | 93.7 | 85.22 | |
| Guo and BarbosaSupervision Strategy=Fully-supervised (Wiki + AIDA CoNLL train)2019.06 | — | — | 92 | 85.7 | |
| Hoffart et al.Supervision Strategy=Wikipedia2019.06 | — | — | 79 | 67.32 | |
| Lazic et al.Supervision Strategy=Wiki + unlab2019.06 | — | — | 86.4 | — | |
| Le and TitovSupervision Strategy=Fully-supervised (Wiki + AIDA CoNLL train)2019.06 | — | — | 93.9 | 85.5 | |
| Milne and WittenSupervision Strategy=Wikipedia2019.06 | — | — | 78 | 77.96 | |
| Our modelSupervision Strategy=Wiki + unlab2019.06 | — | — | 92.2 | 86.18 | |
| Ratinov et al.Supervision Strategy=Wikipedia2019.06 | — | — | 75 | 72.68 |