Relation Extraction on CoNLL 04
79.73F1YAYI-UIE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| YAYI-UIEsupervised evaluation=true2024.11 | 79.73 | — | — | |
| YAYI-UIEEvaluation Mode=Supervised2024.11 | 79.73 | — | — | |
| USM2026.04 | 78.84 | — | — | |
| USMEvaluation Setting=supervised2024.03 | 78.8 | — | — | |
| InstructUIEEvaluation Mode=Supervised2024.11 | 78.48 | — | — | |
| InstructUIEParameters=11B2026.04 | 78.48 | — | — | |
| UIE2026.04 | 76 | — | — | |
| KnowCoderModel=7B, Evaluation Setting=supervised2024.03 | 73.3 | — | — | |
| KnowCoderEvaluation Mode=Supervised2024.11 | 73.3 | — | — | |
| KnowCoderParameters=7B2026.04 | 73.3 | — | — | |
| ProUIEParameters=4B2026.04 | 73.17 | — | — | |
| KnowCoder-Xsupervised evaluation=true2024.11 | 73.14 | — | — | |
| KnowCoder-XEvaluation Mode=Supervised2024.11 | 73.14 | — | — | |
| IEPILEsupervised evaluation=true2024.11 | 72.87 | — | — | |
| IEPILEEvaluation Mode=Supervised2024.11 | 72.87 | — | — | |
| Rainbow CuckooShots=4, Evaluation Protocol=In-domain Transfer2025.02 | 70.47 | — | — | |
| CuckooShots=4, Evaluation Protocol=Few-shot2025.02 | 69.57 | — | — | |
| Cuckoo (Only Post-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 68.66 | — | — | |
| Cuckoo (Only Pre-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 68.14 | — | — | |
| MRQAShots=4, Evaluation Protocol=Few-shot2025.02 | 66.23 | — | — | |
| NuNER+Shots=4, Evaluation Protocol=Few-shot2025.02 | 65.12 | — | — | |
| MetaIE+Shots=4, Evaluation Protocol=Few-shot2025.02 | 64.81 | — | — | |
| HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 63.32 | — | 67.89 | |
| MultiNERD+Shots=4, Evaluation Protocol=Few-shot2025.02 | 57.52 | — | — | |
| Rainbow CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 53.81 | — | — | |
| KD SortModel=Deepseek-v3-660B2025.08 | 51.01 | — | — | |
| LC-ICLParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 50.71 | — | — | |
| APIEModel=Deepseek-v3-660B2025.08 | 50.2 | — | — | |
| FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 50.1 | — | 54.62 | |
| CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 48.95 | — | — | |
| PEParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 48.42 | — | — | |
| Qwen3-32Bcheckpoint=open-source base, fine-tuning=none, parameters=32B2026.06 | 47.68 | — | — | |
| Active-PromptModel=Deepseek-v3-660B2025.08 | 47.66 | — | — | |
| OPT-C4-TuluV3Shots=4, Evaluation Protocol=Few-shot2025.02 | 47.14 | — | — | |
| CodexPrompt Type=code, Shots=12023.05 | 43.05 | 66.8 | — | |
| BCLModel=Qwen-2.5-7b, Token Cost=5012026.06 | 42.46 | — | — | |
| RSLModel=Deepseek-v3-660B2025.08 | 42.32 | — | — | |
| GACSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 42.22 | — | 41.02 | |
| BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 40.2 | — | 44.73 | |
| BCLModel=Llama-3.1-8b, Token Cost=5012026.06 | 38.93 | — | — | |
| Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 37.6 | — | 42.78 | |
| KD SortModel=Gemma-3-12B2025.08 | 36.71 | — | — | |
| EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 35.8 | — | 40.04 | |
| BCLModel=Qwen-2.5-3b, Token Cost=5012026.06 | 35.32 | — | — | |
| APIEModel=Deepseek-R1-14B2025.08 | 34.62 | — | — | |
| ROBERTaShots=4, Evaluation Protocol=Few-shot2025.02 | 34.16 | — | — | |
| KD SortModel=Deepseek-R1-14B2025.08 | 33.11 | — | — | |
| Qwen3-8Bcheckpoint=open-source base, fine-tuning=none, parameters=8B2026.06 | 33.06 | — | — | |
| APIEModel=Qwen-2.5-14B2025.08 | 32.57 | — | — | |
| KD SortModel=Qwen-2.5-14B2025.08 | 32.44 | — | — | |
| LC-ICLParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 32.27 | — | — | |
| Active-PromptModel=Deepseek-R1-14B2025.08 | 32.13 | — | — | |
| Agents-K1 (4B)training=GRPO on IEPile, parameters=4B2026.06 | 31.81 | — | — | |
| ZSLModel=Deepseek-v3-660B2025.08 | 31.74 | — | — | |
| TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 31.08 | — | 34.34 | |
| UniTESource Models=Qwen, Mistral, Target Model=Llama2026.04 | 30.85 | — | 32.25 | |
| RSLModel=Qwen-2.5-14B2025.08 | 30.33 | — | — | |
| Active-PromptModel=Qwen-2.5-14B2025.08 | 29.61 | — | — | |
| Qwen3-4Bcheckpoint=open-source base, fine-tuning=none, parameters=4B2026.06 | 29.33 | — | — | |
| APIEModel=Gemma-3-12B2025.08 | 28.82 | — | — | |
| DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.04 | 28.8 | — | 31.31 | |
| DELLASource Models=Qwen, Mistral, Target Model=Llama2026.04 | 28.78 | — | 31.82 | |
| Active-PromptModel=Gemma-3-12B2025.08 | 28.38 | — | — | |
| One-shotModel=Qwen-2.5-7b, Token Cost=3852026.06 | 28.1 | — | — | |
| RSLModel=Deepseek-R1-14B2025.08 | 27.83 | — | — | |
| ZSLModel=Deepseek-R1-14B2025.08 | 27.3 | — | — | |
| RSLModel=Gemma-3-12B2025.08 | 26.92 | — | — | |
| UIE-largePrompt Type=text, Shots=12023.05 | 25.81 | — | — | |
| BCLModel=Pixtral-12B, Token Cost=5012026.06 | 25.75 | — | — | |
| One-shotModel=Llama-3.1-8b, Token Cost=3852026.06 | 22.57 | — | — | |
| One-shotModel=Pixtral-12B, Token Cost=3852026.06 | 21.7 | — | — | |
| ZSLModel=Gemma-3-12B2025.08 | 20.59 | — | — | |
| One-shotModel=Qwen-2.5-3b, Token Cost=3852026.06 | 19.28 | — | — | |
| PEParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 15.11 | — | — | |
| ChatIEModel=Pixtral-12B, Token Cost=9422026.06 | 14.5 | — | — | |
| ZSLModel=Qwen-2.5-14B2025.08 | 13.69 | — | — | |
| ChatIEModel=Llama-3.1-8b, Token Cost=9422026.06 | 12.62 | — | — | |
| ChatIEModel=Qwen-2.5-7b, Token Cost=9422026.06 | 12.48 | — | — | |
| ChatIEModel=Qwen-2.5-3b, Token Cost=9422026.06 | 11.11 | — | — | |
| DIParadigm=w/o ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 7.02 | — | — | |
| DIParadigm=w/o ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 0.35 | — | — | |
| CodeIEModel=Qwen-2.5-3b, Token Cost=11722026.06 | 0 | — | — | |
| CodeIEModel=Qwen-2.5-7b, Token Cost=11722026.06 | 0 | — | — | |
| CodeIEModel=Llama-3.1-8b, Token Cost=11722026.06 | 0 | — | — | |
| CodeIEModel=Pixtral-12B, Token Cost=11722026.06 | 0 | — | — |