List your company
ResearchFormerly WizWand

Relation Extraction on NYT (F1)

96.41F1 ScoreProUIE
-3.856422.174348.20574.2357Nov 7, 2024Feb 12, 2025May 21, 2025Aug 27, 2025Dec 3, 2025Mar 11, 2026Jun 17, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ProUIEParameters=4B2026.0496.41
KnowCoder-Xsupervised evaluation=true2024.1196.08
KnowCoder-XEvaluation Mode=Supervised2024.1196.08
KnowCoderEvaluation Mode=Supervised2024.1193.7
KnowCoderParameters=7B2026.0493.7
IEPILEsupervised evaluation=true2024.1193
IEPILEEvaluation Mode=Supervised2024.1193
InstructUIEEvaluation Mode=Supervised2024.1191
BCLModel=Llama-3.1-8b, Token Cost=5012026.0691
InstructUIEParameters=11B2026.0490.47
YAYI-UIEsupervised evaluation=true2024.1189.97
YAYI-UIEEvaluation Mode=Supervised2024.1189.97
BCLModel=Pixtral-12B, Token Cost=5012026.0660
One-shotModel=Llama-3.1-8b, Token Cost=3852026.0644
BCLModel=Qwen-2.5-7b, Token Cost=5012026.0643
ChatIEModel=Pixtral-12B, Token Cost=9422026.0640
One-shotModel=Pixtral-12B, Token Cost=3852026.0638
BCLModel=Qwen-2.5-3b, Token Cost=5012026.0631
One-shotModel=Qwen-2.5-3b, Token Cost=3852026.0629
One-shotModel=Qwen-2.5-7b, Token Cost=3852026.0628
ChatIEModel=Qwen-2.5-3b, Token Cost=9422026.060
ChatIEModel=Qwen-2.5-7b, Token Cost=9422026.060
ChatIEModel=Llama-3.1-8b, Token Cost=9422026.060
CodeIEModel=Qwen-2.5-3b, Token Cost=11722026.060
CodeIEModel=Qwen-2.5-7b, Token Cost=11722026.060
CodeIEModel=Llama-3.1-8b, Token Cost=11722026.060
CodeIEModel=Pixtral-12B, Token Cost=11722026.060