Named Entity Recognition on MIT Movie
90.8Entity F1B2NER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| B2NEREvaluation Protocol=Supervised2026.04 | 90.8 | — | |
| B2NEREvaluation Protocol=Supervised2024.11 | 90.78 | — | |
| KnowCoder-7BEvaluation Protocol=Supervised2026.04 | 90.6 | — | |
| UniNER-7BEvaluation Protocol=Supervised2026.04 | 90.2 | — | |
| GNEREvaluation Protocol=Supervised2026.04 | 90.2 | — | |
| InstructUIEEvaluation Protocol=Supervised2026.04 | 89.6 | — | |
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | 89.5 | — | |
| InstructUIEBackbone=11B FlanT52023.04 | 89.01 | — | |
| BERT-baseEvaluation Protocol=Supervised2026.04 | 88.8 | — | |
| Bert-baseBackbone=Bert-base2023.04 | 88.78 | — | |
| IEPILEEvaluation Protocol=Supervised2024.11 | 88.23 | — | |
| GLiNEREvaluation Protocol=Supervised2026.04 | 87.9 | — | |
| BERTEvaluation Protocol=Supervised2024.11 | 86.73 | — | |
| SFT_QwenNote=Task-specific upper bound2026.04 | 85.17 | 86.27 | |
| SFT_LlamaNote=Task-specific upper bound2026.04 | 84.72 | 85.66 | |
| HeteroFusionTransfer=Qwen to Llama2026.04 | 83.29 | 84.46 | |
| HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 83.25 | 84.34 | |
| HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 82.62 | 83.58 | |
| Llama MergeTransfer=Qwen to Llama2026.04 | 79.49 | 80.85 | |
| FuseLLMTransfer=Qwen to Llama2026.04 | 78.24 | 80.88 | |
| DiZiNEREvaluation Protocol=Zero-shot2026.04 | 76.2 | — | |
| FuseLLMTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 75.08 | 79.25 | |
| JPT-4Bzero-shot=true2026.04 | 73.4 | — | |
| GPT-5 miniEvaluation Protocol=Zero-shot, Note=supervisor model2026.04 | 73.3 | — | |
| EvoPromptEvaluation Protocol=Zero-shot2026.04 | 70.9 | — | |
| FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 70.88 | 75.76 | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | 70.14 | — | |
| EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 69.88 | 78.65 | |
| TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 69.69 | 78.96 | |
| Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 68.98 | 74.82 | |
| BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 67.69 | 73.35 | |
| Cuckoo (Only Pre-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 67.23 | — | |
| CuckooShots=4, Evaluation Protocol=Few-shot2025.02 | 67.12 | — | |
| Cuckoo (Only Post-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 67.1 | — | |
| Rainbow CuckooShots=4, Evaluation Protocol=In-domain Transfer2025.02 | 67 | — | |
| DELLATarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 66.72 | 79.47 | |
| DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 66.3 | 78.7 | |
| MRQAShots=4, Evaluation Protocol=Few-shot2025.02 | 66.26 | — | |
| MetaIE+Shots=4, Evaluation Protocol=Few-shot2025.02 | 65.23 | — | |
| NuNER+Shots=4, Evaluation Protocol=Few-shot2025.02 | 64.88 | — | |
| MultiNERD+Shots=4, Evaluation Protocol=Few-shot2025.02 | 63.3 | — | |
| GoLLIEEvaluation Protocol=Zero-shot2026.04 | 63 | — | |
| UniTETarget Model=Qwen2.5-7B-Instruct, Transfer Setting=Multi-source Heterogeneous Transfer2026.04 | 61.42 | 67.53 | |
| UniTESource Models=Qwen, Mistral, Target Model=Llama2026.04 | 61.42 | 67.53 | |
| GACTransfer=Qwen to Llama2026.04 | 60.25 | 64.62 | |
| UniTETransfer=Qwen to Llama2026.04 | 58.52 | 64.39 | |
| GACSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 58.41 | 61.49 | |
| ROBERTaShots=4, Evaluation Protocol=Few-shot2025.02 | 58.32 | — | |
| GLiNER-Lzero-shot=true2026.04 | 57.2 | — | |
| GLiNEREvaluation Protocol=Zero-shot2026.04 | 57.2 | — | |
| OPT-C4-TuluV3Shots=4, Evaluation Protocol=Few-shot2025.02 | 56.33 | — | |
| EMR-MergingTransfer=Qwen to Llama2026.04 | 55.44 | 72.85 | |
| EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 55.44 | 72.85 | |
| gliner_large-v2.5Evaluation Protocol=Zero-shot2026.02 | 53 | — | |
| TIES-MergingTransfer=Qwen to Llama2026.04 | 50.93 | 70.9 | |
| TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 50.93 | 70.9 | |
| DELLATransfer=Qwen to Llama2026.04 | 50.35 | 71.04 | |
| DELLASource Models=Qwen, Mistral, Target Model=Llama2026.04 | 50.35 | 71.04 | |
| gliner_small-v2.5Evaluation Protocol=Zero-shot2026.02 | 50.3 | — | |
| DARE (TIES+)Transfer=Qwen to Llama2026.04 | 50.2 | 70.68 | |
| DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.04 | 50.2 | 70.68 | |
| BreadcrumbsTransfer=Qwen to Llama2026.04 | 48.2 | 64.96 | |
| BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 48.2 | 64.96 | |
| Task ArithmeticTransfer=Qwen to Llama2026.04 | 47.66 | 65.55 | |
| Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 47.66 | 65.55 | |
| UniNER-7Bzero-shot=true2026.04 | 42.4 | — | |
| UniNER-7BEvaluation Protocol=Zero-shot2026.04 | 42.4 | — | |
| gliner_medium-v2.5Evaluation Protocol=Zero-shot2026.02 | 41.4 | — | |
| Rainbow CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 29.53 | — | |
| CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 9.06 | — | |
| ChatGPTEvaluation Protocol=Zero-shot2026.04 | 5.3 | — |