Entity Disambiguation on WIKI (test)
89.2Micro F1LUKE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LUKEfine-tuning=none, ordering=natural-order2019.09 | 89.2 | — | |
| LUKEfine-tuning=none, ordering=confidence-order2019.09 | 89.1 | — | |
| Barba et al.2019.09 | 88.8 | — | |
| LUKEfine-tuning=none, ordering=local2019.09 | 88.8 | — | |
| ReFinED (Wikipedia)Evaluation Protocol=Wikipedia pre-training2022.07 | 88.7 | — | |
| ReFinED (w/o entity priors)Ablation configuration=w/o entity priors (Wikipedia)2022.07 | 88.3 | — | |
| LUKEfine-tuning=CoNLL dataset, ordering=confidence-order2019.09 | 87.6 | — | |
| Cao et al.2019.09 | 87.4 | — | |
| LUKEfine-tuning=CoNLL dataset, ordering=natural-order2019.09 | 87.4 | — | |
| Cao et al. (2020)2022.07 | 87.4 | — | |
| ReFinED (fine-tuned)Evaluation Protocol=fine-tuned on AIDA2022.07 | 87.4 | — | |
| LUKEfine-tuning=CoNLL dataset, ordering=local2019.09 | 87.2 | — | |
| ReFinED (w/o entity types)Ablation configuration=w/o entity types (Wikipedia)2022.07 | 87 | — | |
| ReFinED (w/o descriptions)Ablation configuration=w/o descriptions (Wikipedia)2022.07 | 84.3 | — | |
| Fang et al.2019.09 | 82.8 | — | |
| Fang et al. (2019)2022.07 | 82.8 | — | |
| Yang et al.year=20182019.09 | 79.2 | — | |
| Yang et al. (2018)2022.07 | 79.2 | — | |
| Yang et al.year=20192019.09 | 78.8 | — | |
| Yang et al. (2019)2022.07 | 78.8 | — | |
| Le and Titov2019.09 | 78 | — | |
| Ganea and Hofmann2019.09 | 77.5 | — | |
| Orr et al. (2021)2022.07 | 76.2 | — | |
| ReFinED (w/o pretraining)Ablation configuration=w/o pretraining (fine-tuned)2022.07 | 74.5 | — | |
| Wu et al. (2020)metric_reported=Normalised accuracy2022.07 | — | 86.1 |