Named Entity Recognition on CoNLL English 2003
94.3F1 ScoreLUKE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LUKEspan representation=concatenating representations of first and last words and entity representation2020.10 | 94.3 | — | — | — | |
| Biaffine NER2020.05 | 93.5 | 93.7 | 93.3 | — | |
| Baevski et al. (2019)2020.10 | 93.5 | — | — | — | |
| Straková et al.2020.05 | 93.4 | — | — | — | |
| Akbik et al. (2018)2020.10 | 93.1 | — | — | — | |
| Shen et al. (2021a)2022.03 | 92.94 | 92.13 | 93.73 | — | |
| Li et al. (2020b)reproduced_by=Yan et al. (2021)2022.03 | 92.87 | 92.47 | 93.27 | — | |
| PIQN2022.03 | 92.87 | 93.29 | 92.46 | — | |
| Devlin et al.2020.05 | 92.8 | — | — | — | |
| BERT2020.10 | 92.8 | — | — | — | |
| Devlin et al. (2019)2022.03 | 92.8 | — | — | — | |
| Yu et al. (2020)reproduced_by=Yan et al. (2021)2022.03 | 92.5 | 92.85 | 92.15 | — | |
| RoBERTaspan representation=concatenating representations of first and last words2020.10 | 92.4 | — | — | — | |
| Peters et al. (2018)2022.03 | 92.22 | — | — | — | |
| ELMo2020.10 | 92.2 | — | — | — | |
| Chiu and Nichols2020.05 | 91.6 | 91.4 | 91.9 | — | |
| LSTM-CRF2020.10 | 91 | — | — | — | |
| Lample et al.2020.05 | 90.9 | — | — | — | |
| Strubell et al.2020.05 | 90.7 | — | — | — | |
| CodeNERBackbone=GPT-4, Evaluation Protocol=Zero-shot2025.07 | — | — | — | 69.48 | |
| CodeNERBackbone=GPT-4 turbo, Evaluation Protocol=Zero-shot2025.07 | — | — | — | 68.31 | |
| VanillaBackbone=GPT-4, Evaluation Protocol=Zero-shot2025.07 | — | — | — | 73.24 | |
| VanillaBackbone=GPT-4 turbo, Evaluation Protocol=Zero-shot2025.07 | — | — | — | 74.54 |