Named Entity Recognition on CoNLL (test)
92.7F1 Score (AVG)DiffusionSL (paper)
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DiffusionSL (paper)Encoder=Bert-large-cased2026.06 | 92.7 | — | — | — | — | — | — | — | — | — | — | — | 93.15 | 92.26 | |
| DiffusionSL (ours)Encoder=Bert-large-cased2026.06 | 92.38 | — | — | — | — | — | — | — | — | — | — | — | 92.58 | 92.18 | |
| Diffusion-CRFEncoder=Bert-large-cased2026.06 | 92.36 | — | — | — | — | — | — | — | — | — | — | — | 91.88 | 92.85 | |
| CRFEncoder=Bert-large-cased2026.06 | 92.13 | — | — | — | — | — | — | — | — | — | — | — | 91.66 | 92.61 | |
| Diffusion-MFEncoder=Bert-large-cased, config=5 iter no tanh no mask2026.06 | 92.03 | — | — | — | — | — | — | — | — | — | — | — | 91.49 | 92.56 | |
| Diffusion-UniEncoder=Bert-large-cased2026.06 | 92.01 | — | — | — | — | — | — | — | — | — | — | — | 91.52 | 92.5 | |
| UnigramEncoder=Bert-large-cased2026.06 | 91.76 | — | — | — | — | — | — | — | — | — | — | — | 91.47 | 92.06 | |
| CoLaDaBase Encoder=XLM-R2023.05 | 82.99 | — | — | 81.12 | 82.7 | 85.15 | — | — | — | — | — | — | — | — | |
| ContProtounlabeled data usage=self-training, tagging scheme=span-based2023.05 | 81.71 | — | — | 76.41 | 85.02 | 83.69 | — | — | — | — | — | — | — | — | |
| CoLaDaBase Encoder=mBERT2023.05 | 80.94 | — | — | 77.3 | 80.43 | 85.09 | — | — | — | — | — | — | — | — | |
| MTMTunlabeled data usage=self-training2023.05 | 80.68 | — | — | 76.8 | 81.82 | 83.41 | — | — | — | — | — | — | — | — | |
| MTMTBase Encoder=mBERT2023.05 | 80.67 | — | — | 76.8 | 81.82 | 83.41 | — | — | — | — | — | — | — | — | |
| ConNERBase Encoder=XLM-R2023.05 | 80.29 | — | — | 77.14 | 80.5 | 83.23 | — | — | — | — | — | — | — | — | |
| TOFBase Encoder=mBERT2023.05 | 79.9 | — | — | 76.57 | 80.35 | 82.79 | — | — | — | — | — | — | — | — | |
| AdvPickerunlabeled data usage=self-training, tagging scheme=span-based2023.05 | 79.88 | — | — | 73.93 | 84.7 | 81.01 | — | — | — | — | — | — | — | — | |
| RIKDunlabeled data usage=self-training2023.05 | 79.75 | — | — | 78.4 | 79.46 | 81.4 | — | — | — | — | — | — | — | — | |
| UniTransBase Encoder=mBERT2023.05 | 79.01 | — | — | 74.82 | 79.31 | 82.9 | — | — | — | — | — | — | — | — | |
| Unitransunlabeled data usage=self-training2023.05 | 79.01 | — | — | 74.82 | 79.31 | 82.9 | — | — | — | — | — | — | — | — | |
| AdvPickerBase Encoder=mBERT2023.05 | 78.97 | — | — | 75.01 | 79 | 82.9 | — | — | — | — | — | — | — | — | |
| AdvPickerunlabeled data usage=self-training, tagging scheme=seq-tagging2023.05 | 78.97 | — | — | 75.01 | 79 | 82.9 | — | — | — | — | — | — | — | — | |
| xTuneBase Encoder=XLM-R2023.05 | 78.85 | — | — | 74.78 | 80.03 | 81.76 | — | — | — | — | — | — | — | — | |
| RIKDBase Encoder=mBERT2023.05 | 78.59 | — | — | 75.48 | 77.84 | 82.46 | — | — | — | — | — | — | — | — | |
| TSLunlabeled data usage=self-training2023.05 | 78.22 | — | — | 75.33 | 78 | 81.33 | — | — | — | — | — | — | — | — | |
| mBERT (Reference [2])Reference=[2]2021.06 | 78.2 | — | 90.6 | 69.2 | 75.4 | 77.9 | — | — | — | — | — | — | — | — | |
| Syntax-augmented mBERTsyntax-augmented=true2021.06 | 78 | — | 90.6 | 69.1 | 73.6 | 78.5 | — | — | — | — | — | — | — | — | |
| mBERTbaseline=true2021.06 | 77.8 | — | 90.7 | 68.3 | 74.5 | 77.6 | — | — | — | — | — | — | — | — | |
| MulDABase Encoder=XLM-R2023.05 | 77.64 | — | — | 74.55 | 78.14 | 80.22 | — | — | — | — | — | — | — | — | |
| TSLBase Encoder=mBERT2023.05 | 76.78 | — | — | 73.16 | 76.75 | 80.44 | — | — | — | — | — | — | — | — | |
| AdvCEBase Encoder=mBERT2023.05 | 74.6 | — | — | 71.9 | 74.3 | 77.6 | — | — | — | — | — | — | — | — | |
| AdvCEunlabeled data usage=w/o unlabeled data2023.05 | 74.6 | — | — | 71.9 | 74.3 | 77.6 | — | — | — | — | — | — | — | — | |
| BERT-funlabeled data usage=w/o unlabeled data2023.05 | 74.03 | — | — | 69.56 | 74.96 | 77.57 | — | — | — | — | — | — | — | — | |
| mBERTBase Encoder=mBERT2023.05 | 73.57 | — | — | 69.56 | 74.96 | 77.57 | — | — | — | — | — | — | — | — | |
| TMPunlabeled data usage=w/o unlabeled data2023.05 | 68.3 | — | — | 61.5 | 73.5 | 69.9 | — | — | — | — | — | — | — | — | |
| WSunlabeled data usage=w/o unlabeled data2023.05 | 63 | — | — | 58.5 | 65.1 | 65.4 | — | — | — | — | — | — | — | — | |
| Wikiunlabeled data usage=w/o unlabeled data2023.05 | 56.74 | — | — | 48.12 | 60.55 | 61.56 | — | — | — | — | — | — | — | — | |
| Clean2023.05 | — | 0.8872 | — | — | — | — | — | 97.39 | 64.6 | 18.48 | — | — | — | — | |
| Collobert et al. (2011)LEX=false, GAZ=false, CAP=true, EMB=true, CHE=false, LME=false, LS=false2018.06 | — | 0.8956 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CONTAINERFew-shot setting=0 < k < 5, Number of runs=52023.05 | — | — | — | — | — | — | 75.8 | — | — | — | — | — | — | — | |
| COPNERFew-shot setting=0 < k < 5, Number of runs=52023.05 | — | — | — | — | — | — | 75.8 | — | — | — | — | — | — | — | |
| EntLMFew-shot setting=0 < k < 5, Number of runs=52023.05 | — | — | — | — | — | — | 51.32 | — | — | — | — | — | — | — | |
| FactMixFew-shot setting=0 < k < 5, Number of runs=not specified2023.05 | — | — | — | — | — | — | 60.8 | — | — | — | — | — | — | — | |
| Finkel et al. (2005)LEX=true, GAZ=true, CAP=true, EMB=false, CHE=false, LME=false, LS=false2018.06 | — | 0.8686 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Huang et al. (2015)LEX=false, GAZ=false, CAP=true, EMB=true, CHE=true, LME=false, LS=false2018.06 | — | 0.901 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lample et al. (2016)LEX=false, GAZ=false, CAP=false, EMB=true, CHE=true, LME=false, LS=false2018.06 | — | 0.9094 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lexical Similarity Model (This work)LEX=false, GAZ=false, CAP=false, EMB=true, CHE=true, LME=true, LS=true2018.06 | — | 0.9173 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lin and Wu (2009)LEX=true, GAZ=true, CAP=true, EMB=false, CHE=false, LME=false, LS=false2018.06 | — | 0.909 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Liu et al. (2017)LEX=false, GAZ=false, CAP=false, EMB=true, CHE=true, LME=true, LS=false2018.06 | — | 0.9171 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Luo et al. (2015)LEX=true, GAZ=true, CAP=true, EMB=false, CHE=false, LME=false, LS=false2018.06 | — | 0.912 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ma and Hovy (2016)LEX=false, GAZ=false, CAP=true, EMB=true, CHE=true, LME=false, LS=false2018.06 | — | 0.9121 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PMRFew-shot setting=0 < k < 5, Number of runs=52023.05 | — | — | — | — | — | — | 65.7 | — | — | — | — | — | — | — | |
| ProMLFew-shot setting=0 < k < 5, Number of runs=52023.05 | — | — | — | — | — | — | 79.16 | — | — | — | — | — | — | — | |
| PromptNER GPT3.5Few-shot setting=0 < k < 5, Backbone=GPT3.5, Number of runs=52023.05 | — | — | — | — | — | — | 78.62 | — | — | — | — | — | — | — | |
| PromptNER GPT4Few-shot setting=0 < k < 5, Backbone=GPT4, Number of runs=52023.05 | — | — | — | — | — | — | 83.48 | — | — | — | — | — | — | — | |
| PromptNER T5XXLFew-shot setting=0 < k < 5, Backbone=T5XXL, Number of runs=52023.05 | — | — | — | — | — | — | 45.66 | — | — | — | — | — | — | — | |
| Ratinov and Roth (2009)LEX=true, GAZ=true, CAP=true, EMB=false, CHE=false, LME=false, LS=false2018.06 | — | 0.9088 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Shen et al. (2017)LEX=false, GAZ=false, CAP=true, EMB=true, CHE=true, LME=false, LS=false2018.06 | — | 0.9089 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Strubell et al. (2017)LEX=false, GAZ=false, CAP=false, EMB=true, CHE=true, LME=true, LS=false2018.06 | — | 0.9054 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Tran et al. (2017)LEX=false, GAZ=false, CAP=false, EMB=true, CHE=true, LME=true, LS=false2018.06 | — | 0.9169 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UIEFew-shot setting=0 < k < 5, Number of runs=not specified2023.05 | — | — | — | — | — | — | 67.09 | — | — | — | — | — | — | — | |
| UOR2023.05 | — | 0.8854 | — | — | — | — | — | 97.45 | 81.44 | 25.49 | — | — | — | — | |
| UOR-G2023.05 | — | 0.8862 | — | — | — | — | — | 97.45 | 90.99 | 33.32 | — | — | — | — |