List your company
ResearchFormerly WizWand

Relation Extraction on CoNLL 04

79.73F1YAYI-UIE
-3.189218.337939.86561.3921May 9, 2023Nov 16, 2023May 25, 2024Dec 2, 2024Jun 11, 2025Dec 19, 2025Jun 28, 2026
Updated 4mo ago

Evaluation results

MethodLinks
YAYI-UIEsupervised evaluation=true2024.1179.73——
YAYI-UIEEvaluation Mode=Supervised2024.1179.73——
USM2026.0478.84——
USMEvaluation Setting=supervised2024.0378.8——
InstructUIEEvaluation Mode=Supervised2024.1178.48——
InstructUIEParameters=11B2026.0478.48——
UIE2026.0476——
KnowCoderModel=7B, Evaluation Setting=supervised2024.0373.3——
KnowCoderEvaluation Mode=Supervised2024.1173.3——
KnowCoderParameters=7B2026.0473.3——
ProUIEParameters=4B2026.0473.17——
KnowCoder-Xsupervised evaluation=true2024.1173.14——
KnowCoder-XEvaluation Mode=Supervised2024.1173.14——
IEPILEsupervised evaluation=true2024.1172.87——
IEPILEEvaluation Mode=Supervised2024.1172.87——
Rainbow CuckooShots=4, Evaluation Protocol=In-domain Transfer2025.0270.47——
CuckooShots=4, Evaluation Protocol=Few-shot2025.0269.57——
Cuckoo (Only Post-train)Shots=4, Evaluation Protocol=Few-shot2025.0268.66——
Cuckoo (Only Pre-train)Shots=4, Evaluation Protocol=Few-shot2025.0268.14——
MRQAShots=4, Evaluation Protocol=Few-shot2025.0266.23——
NuNER+Shots=4, Evaluation Protocol=Few-shot2025.0265.12——
MetaIE+Shots=4, Evaluation Protocol=Few-shot2025.0264.81——
HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.0463.32—67.89
MultiNERD+Shots=4, Evaluation Protocol=Few-shot2025.0257.52——
Rainbow CuckooShots=0, Evaluation Protocol=Zero-shot2025.0253.81——
KD SortModel=Deepseek-v3-660B2025.0851.01——
LC-ICLParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.0650.71——
APIEModel=Deepseek-v3-660B2025.0850.2——
FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.0450.1—54.62
CuckooShots=0, Evaluation Protocol=Zero-shot2025.0248.95——
PEParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.0648.42——
Qwen3-32Bcheckpoint=open-source base, fine-tuning=none, parameters=32B2026.0647.68——
Active-PromptModel=Deepseek-v3-660B2025.0847.66——
OPT-C4-TuluV3Shots=4, Evaluation Protocol=Few-shot2025.0247.14——
CodexPrompt Type=code, Shots=12023.0543.0566.8—
BCLModel=Qwen-2.5-7b, Token Cost=5012026.0642.46——
RSLModel=Deepseek-v3-660B2025.0842.32——
GACSource Models=Qwen, Mistral, Target Model=Llama2026.0442.22—41.02
BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.0440.2—44.73
BCLModel=Llama-3.1-8b, Token Cost=5012026.0638.93——
Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.0437.6—42.78
KD SortModel=Gemma-3-12B2025.0836.71——
EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0435.8—40.04
BCLModel=Qwen-2.5-3b, Token Cost=5012026.0635.32——
APIEModel=Deepseek-R1-14B2025.0834.62——
ROBERTaShots=4, Evaluation Protocol=Few-shot2025.0234.16——
KD SortModel=Deepseek-R1-14B2025.0833.11——
Qwen3-8Bcheckpoint=open-source base, fine-tuning=none, parameters=8B2026.0633.06——
APIEModel=Qwen-2.5-14B2025.0832.57——
KD SortModel=Qwen-2.5-14B2025.0832.44——
LC-ICLParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.0632.27——
Active-PromptModel=Deepseek-R1-14B2025.0832.13——
Agents-K1 (4B)training=GRPO on IEPile, parameters=4B2026.0631.81——
ZSLModel=Deepseek-v3-660B2025.0831.74——
TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0431.08—34.34
UniTESource Models=Qwen, Mistral, Target Model=Llama2026.0430.85—32.25
RSLModel=Qwen-2.5-14B2025.0830.33——
Active-PromptModel=Qwen-2.5-14B2025.0829.61——
Qwen3-4Bcheckpoint=open-source base, fine-tuning=none, parameters=4B2026.0629.33——
APIEModel=Gemma-3-12B2025.0828.82——
DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.0428.8—31.31
DELLASource Models=Qwen, Mistral, Target Model=Llama2026.0428.78—31.82
Active-PromptModel=Gemma-3-12B2025.0828.38——
One-shotModel=Qwen-2.5-7b, Token Cost=3852026.0628.1——
RSLModel=Deepseek-R1-14B2025.0827.83——
ZSLModel=Deepseek-R1-14B2025.0827.3——
RSLModel=Gemma-3-12B2025.0826.92——
UIE-largePrompt Type=text, Shots=12023.0525.81——
BCLModel=Pixtral-12B, Token Cost=5012026.0625.75——
One-shotModel=Llama-3.1-8b, Token Cost=3852026.0622.57——
One-shotModel=Pixtral-12B, Token Cost=3852026.0621.7——
ZSLModel=Gemma-3-12B2025.0820.59——
One-shotModel=Qwen-2.5-3b, Token Cost=3852026.0619.28——
PEParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.0615.11——
ChatIEModel=Pixtral-12B, Token Cost=9422026.0614.5——
ZSLModel=Qwen-2.5-14B2025.0813.69——
ChatIEModel=Llama-3.1-8b, Token Cost=9422026.0612.62——
ChatIEModel=Qwen-2.5-7b, Token Cost=9422026.0612.48——
ChatIEModel=Qwen-2.5-3b, Token Cost=9422026.0611.11——
DIParadigm=w/o ICL, Backbone=Llama-3.3-70B-Instruct2026.067.02——
DIParadigm=w/o ICL, Backbone=Llama-3.1-8B-Instruct2026.060.35——
CodeIEModel=Qwen-2.5-3b, Token Cost=11722026.060——
CodeIEModel=Qwen-2.5-7b, Token Cost=11722026.060——
CodeIEModel=Llama-3.1-8b, Token Cost=11722026.060——
CodeIEModel=Pixtral-12B, Token Cost=11722026.060——