Named Entity Recognition on tweetNER7
67.98Entity F1KnowCoder-X
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | 67.98 | — | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | 66.99 | — | |
| ProUIEParameters=4B2026.04 | 66.44 | — | |
| B2NEREvaluation Protocol=Supervised2024.11 | 66.26 | — | |
| InstructUIE2023.04 | 66 | — | |
| InstructUIEParameters=11B2026.04 | 65.95 | — | |
| UniversalNERParameters=7B2026.04 | 65.77 | — | |
| InstructUIEBackbone=11B FlanT52023.04 | 64.97 | — | |
| SFT_LlamaNote=Task-specific upper bound2026.04 | 62.56 | 65.41 | |
| SFT_QwenNote=Task-specific upper bound2026.04 | 62.4 | 65.12 | |
| HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 57.6 | 62.11 | |
| BERTEvaluation Protocol=Supervised2024.11 | 56.49 | — | |
| Bert-baseBackbone=Bert-base2023.04 | 56.49 | — | |
| BERT-base2026.04 | 56.49 | — | |
| Llama MergeTransfer=Qwen to Llama2026.04 | 56.05 | 60.47 | |
| DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 55.62 | 71.77 | |
| DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 55.58 | 71.58 | |
| FuseLLMTransfer=Qwen to Llama2026.04 | 55.15 | 59.97 | |
| HeteroFusionTransfer=Qwen to Llama2026.04 | 55.04 | 59.24 | |
| TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 54.8 | 67.88 | |
| HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 54.38 | 57.71 | |
| EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 53.58 | 65.91 | |
| FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 52.79 | 58.21 | |
| FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 50.76 | 60.3 | |
| Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 49.72 | 57.03 | |
| JPT-4Bzero-shot=true2026.04 | 49.7 | — | |
| UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 48.52 | 56.68 | |
| UniTESource Models=Qwen, Mistral, Target Model=Llama2026.04 | 48.52 | 56.68 | |
| BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 47.33 | 54.07 | |
| GACSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 45.74 | 50.8 | |
| UniTETransfer=Qwen to Llama2026.04 | 43.45 | 47.06 | |
| TIES-MergingTransfer=Qwen to Llama2026.04 | 43.04 | 69.57 | |
| TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 43.04 | 69.57 | |
| DELLATransfer=Qwen to Llama2026.04 | 42.72 | 69.29 | |
| DELLASource Models=Qwen, Mistral, Target Model=Llama2026.04 | 42.72 | 69.29 | |
| UniNER-7Bzero-shot=true2026.04 | 42.7 | — | |
| GACTransfer=Qwen to Llama2026.04 | 42.67 | 45.34 | |
| EMR-MergingTransfer=Qwen to Llama2026.04 | 42.41 | 65.48 | |
| EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 42.41 | 65.48 | |
| DARE (TIES+)Transfer=Qwen to Llama2026.04 | 42.39 | 68.32 | |
| DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.04 | 42.39 | 68.32 | |
| GLiNER-Lzero-shot=true2026.04 | 41.4 | — | |
| gliner_small-v2.5Evaluation Protocol=Zero-shot2026.02 | 38.9 | — | |
| gliner_large-v2.5Evaluation Protocol=Zero-shot2026.02 | 38.9 | — | |
| gliner_medium-v2.5Evaluation Protocol=Zero-shot2026.02 | 38.6 | — | |
| BreadcrumbsTransfer=Qwen to Llama2026.04 | 37.47 | 61.62 | |
| BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 37.47 | 61.62 | |
| Task ArithmeticTransfer=Qwen to Llama2026.04 | 36.34 | 61.21 | |
| Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 36.34 | 61.21 |