Named Entity Recognition on CrossNER
75.8AI ScoreCascadeNER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CascadeNEREvaluation Protocol=few-shot2024.09 | 75.8 | 75.2 | 83.2 | 82.4 | 77.1 | — | |
| JPT-8Bevaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 71.9 | 72.2 | 85.3 | 77 | 71.3 | — | |
| CascadeNEREvaluation Protocol=zero-shot2024.09 | 68.9 | 71.7 | 79.3 | 80.5 | 73.6 | — | |
| JPT-4Bevaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 68.3 | 73.7 | 84.1 | 76.4 | 69.5 | — | |
| GNER-T5params=770M, Evaluation Protocol=instruction tuned or finetuned2025.12 | 68.2 | 68.7 | 81.2 | 75.1 | 76.7 | 69.1 | |
| CPNERk=100-2002023.05 | 66.39 | 72.17 | 80.28 | 76.35 | 76.83 | — | |
| LANERk=100-2002023.05 | 65.79 | 71.11 | 78.78 | 74.06 | 71.83 | — | |
| PromptNER GPT4k=2, Backbone=GPT42023.05 | 64.83 | 74.44 | 84.26 | 78.61 | 72.59 | — | |
| PromptNER2024.09 | 64.8 | 74.44 | 84.2 | 78.6 | 72.6 | — | |
| BERT-MRC+DSC2024.09 | 63.2 | 67.8 | 74.5 | 76.1 | 68.7 | — | |
| GNER-LLaMAparams=13B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 63.1 | 68.2 | 75.7 | 69.4 | 69.9 | 66.1 | |
| UniNEREvaluation Setting=Zero-shot2025.06 | 62.9 | 64.9 | 70.6 | 66.9 | 70.8 | — | |
| UniNER-type+supparams=7B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 62.9 | 64.9 | 70 | 66.9 | 70.8 | 55.4 | |
| UniNER-7Bevaluation_mode=zero-shot, paradigm=Generative2026.04 | 62.9 | 64.9 | 70.6 | 66.9 | 70.8 | — | |
| LOCUSparams=470M, Evaluation Protocol=ours- few-shot2025.12 | 62.88 | 62.9 | 74.37 | 76.39 | 65.99 | 69.76 | |
| GUIDEXParams=8B, Backbone=LLaMA3.1, Zero-shot cross-domain=true2026.05 | 62.4 | 63.8 | 67.9 | 69.6 | 64.6 | 65.7 | |
| EnTDAk=1002023.05 | 62.31 | 68.04 | 76.55 | 72.98 | 72.55 | — | |
| GoLLIEParams=34B, Backbone=CodeLLaMA, Zero-shot cross-domain=true2026.05 | 61.6 | 59.1 | 68.4 | 60.2 | 56.3 | 61.1 | |
| SaMBase Model=Llama3.1-8B, Training Strategy=SaM, Evaluation Setting=Zero-shot2025.06 | 60.98 | 66.93 | 73.53 | 74.47 | 62.6 | — | |
| SaM (MoE)evaluation_mode=zero-shot, paradigm=Generative2026.04 | 60.9 | 66.9 | 73.5 | 74.4 | 62.6 | — | |
| LOCUSminiparams=5M, Evaluation Protocol=ours- few-shot2025.12 | 60.36 | 63.86 | 74.31 | 76.07 | 64.4 | 69 | |
| KnowCoderEvaluation Setting=Zero-shot2025.06 | 60.3 | 61.1 | 70 | 72.2 | 59.1 | — | |
| KnowCoderParams=7B, Backbone=LLaMA2, Zero-shot cross-domain=true2026.05 | 60.3 | 61.1 | 70 | 72.2 | 59.1 | 64.5 | |
| SaMBase Model=Qwen2.5-7B, Training Strategy=SaM, Evaluation Setting=Zero-shot2025.06 | 60.01 | 61.99 | 65.93 | 67.05 | 62.41 | — | |
| PromptNER GPT3.5k=2, Backbone=GPT3.52023.05 | 59.35 | 64.15 | 77.78 | 71.74 | 64.83 | — | |
| GoLLIEEvaluation Setting=Zero-shot2025.06 | 59.1 | 62.7 | 67.8 | 57.2 | 55.5 | — | |
| GoLLIEparams=7B, Evaluation Protocol=zero-shot2025.12 | 59.1 | 62.7 | 67.8 | 57.2 | 55.5 | 58 | |
| GoLLIEparams=13B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 59.1 | 62.7 | 67.8 | 57.2 | 55.5 | 58.4 | |
| GoLLIEevaluation_mode=zero-shot, paradigm=Generative2026.04 | 59.1 | 62.7 | 67.8 | 57.2 | 55.5 | — | |
| B2NEREvaluation Setting=Zero-shot2025.06 | 59 | 63.7 | 68.6 | 67.8 | 72 | — | |
| XLM-RoBERTa2024.09 | 59 | 65.9 | 72.1 | 70.8 | 66.9 | — | |
| SAM-NERParams=8B, Backbone=LLaMA3, Zero-shot cross-domain=true2026.05 | 58.2 | 68.7 | 71.2 | 68.2 | 65.1 | 66.3 | |
| RA-IT (50K)params=8B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 58.01 | 63.6 | 64.76 | 61.9 | 62.79 | 56.72 | |
| GPT-NER2024.09 | 58 | 61.2 | 60.8 | 62.4 | 55.8 | — | |
| SAM-NERParams=7B, Backbone=Qwen2.5, Zero-shot cross-domain=true2026.05 | 57.9 | 64.1 | 69.3 | 66.7 | 62.1 | 64.3 | |
| GLiNEREvaluation Setting=Zero-shot, Parameters=300M2025.06 | 57.2 | 64.4 | 69.6 | 72.6 | 62.6 | — | |
| GLiNER-Lparams=450M, Evaluation Protocol=instruction tuned or finetuned2025.12 | 57.2 | 64.2 | 69.6 | 72.6 | 62.6 | 60.9 | |
| GLiNER-Levaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 57.2 | 64.4 | 69.6 | 72.6 | 62.6 | — | |
| GLiNER-LargeParams=0.3B, Backbone=DeBERTa-v3, Zero-shot cross-domain=true2026.05 | 57.2 | 64.4 | 69.6 | 72.6 | 62.6 | 65.3 | |
| UniNER-13Bparams=13B, Evaluation Protocol=zero-shot2025.12 | 54.2 | 60.9 | 64.5 | 61.4 | 63.5 | 55.6 | |
| UniNERParams=13B, Backbone=LLaMA, Zero-shot cross-domain=true2026.05 | 54.2 | 60.9 | 64.5 | 61.4 | 63.5 | 60.9 | |
| LlamaBase Model=Llama3.1-8B, Training Strategy=Fully-trained, Evaluation Setting=Zero-shot2025.06 | 54.11 | 63.44 | 72.53 | 62.92 | 59.09 | — | |
| UniNER-7Bparams=7B, Evaluation Protocol=zero-shot2025.12 | 53.5 | 59.4 | 65 | 60.8 | 61.1 | 53.4 | |
| IRRA-GuidelinesParams=8B, Backbone=LLaMA3, Zero-shot cross-domain=true, Guidelines settings=true2026.05 | 53.2 | 57.7 | 64.7 | 66.2 | 64.1 | 61.2 | |
| GPT-3.5-turboparams=175B, Evaluation Protocol=zero-shot2025.12 | 52.4 | 39.8 | 66.6 | 68.5 | 67 | 47.5 | |
| QwenBase Model=Qwen2.5-7B, Training Strategy=Fully-trained, Evaluation Setting=Zero-shot2025.06 | 51.38 | 53.46 | 61.12 | 54.99 | 59.39 | — | |
| IEPile-Llama3-8BParams=8B, Backbone=Llama3, Zero-shot cross-domain=true2026.05 | 50.2 | 43.3 | 53.7 | 57 | 50.4 | 50.9 | |
| SLIMERparams=7B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 50.1 | 58.7 | 60 | 63.9 | 56.3 | 54 | |
| GPT-4oparams=-, Evaluation Protocol=few-shot2025.12 | 49.98 | 76.79 | 68.71 | 53.98 | 75.85 | 62.95 | |
| InstructUIEparams=11B, Evaluation Protocol=zero-shot2025.12 | 49 | 47.2 | 53.2 | 48.1 | 49.2 | 47.2 | |
| InstructUIEevaluation_mode=zero-shot, paradigm=Generative2026.04 | 49 | 47.2 | 53.2 | 48.2 | 49.3 | — | |
| InstructUIEParams=11B, Backbone=Flan-T5, Zero-shot cross-domain=true2026.05 | 49 | 42.7 | 53.2 | 48.1 | 49.2 | 48.4 | |
| InstructUIEEvaluation Setting=Zero-shot2025.06 | 48.4 | 48.8 | 54.4 | 49.9 | 49.4 | — | |
| FactMixk=1002023.05 | 32.09 | 28.89 | 23.75 | 44.66 | 34.13 | — | |
| PromptNER T5XXLk=2, Backbone=T5XXL2023.05 | 30.67 | 36.55 | 41.93 | 39.43 | 46.32 | — | |
| USMparams=2B, Evaluation Protocol=zero-shot2025.12 | 28.2 | 56 | 44.9 | 36.1 | 44 | 37.8 | |
| Vicuna-13Bparams=13B, Evaluation Protocol=zero-shot2025.12 | 22.7 | 22.7 | 26.6 | 27 | 22 | 17.5 | |
| ACEInput Context=document-context2024.09 | 17.2 | 22.6 | 23.8 | 35.1 | 32.3 | — | |
| Vicuna-7Bparams=7B, Evaluation Protocol=zero-shot2025.12 | 12.8 | 16.1 | 17 | 20.5 | 13 | 13 | |
| BERTTaggerCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 56.9 | |
| Example-basedCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 30.4 | |
| MP-NSPCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 49.2 | |
| NeighborTaggerCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 4.8 | |
| PromptNERCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 76 | |
| TemplateNERCross-domain transfer=CoNLL03 to Target2023.05 | — | — | — | — | — | 68.3 |