Relation Extraction on NYT (F1)
96.41F1 ScoreProUIE
Evaluation Results
| Method | Links | |
|---|---|---|
| ProUIEParameters=4B2026.04 | 96.41 | |
| KnowCoder-Xsupervised evaluation=true2024.11 | 96.08 | |
| KnowCoder-XEvaluation Mode=Supervised2024.11 | 96.08 | |
| KnowCoderEvaluation Mode=Supervised2024.11 | 93.7 | |
| KnowCoderParameters=7B2026.04 | 93.7 | |
| IEPILEsupervised evaluation=true2024.11 | 93 | |
| IEPILEEvaluation Mode=Supervised2024.11 | 93 | |
| InstructUIEEvaluation Mode=Supervised2024.11 | 91 | |
| BCLModel=Llama-3.1-8b, Token Cost=5012026.06 | 91 | |
| InstructUIEParameters=11B2026.04 | 90.47 | |
| YAYI-UIEsupervised evaluation=true2024.11 | 89.97 | |
| YAYI-UIEEvaluation Mode=Supervised2024.11 | 89.97 | |
| BCLModel=Pixtral-12B, Token Cost=5012026.06 | 60 | |
| One-shotModel=Llama-3.1-8b, Token Cost=3852026.06 | 44 | |
| BCLModel=Qwen-2.5-7b, Token Cost=5012026.06 | 43 | |
| ChatIEModel=Pixtral-12B, Token Cost=9422026.06 | 40 | |
| One-shotModel=Pixtral-12B, Token Cost=3852026.06 | 38 | |
| BCLModel=Qwen-2.5-3b, Token Cost=5012026.06 | 31 | |
| One-shotModel=Qwen-2.5-3b, Token Cost=3852026.06 | 29 | |
| One-shotModel=Qwen-2.5-7b, Token Cost=3852026.06 | 28 | |
| ChatIEModel=Qwen-2.5-3b, Token Cost=9422026.06 | 0 | |
| ChatIEModel=Qwen-2.5-7b, Token Cost=9422026.06 | 0 | |
| ChatIEModel=Llama-3.1-8b, Token Cost=9422026.06 | 0 | |
| CodeIEModel=Qwen-2.5-3b, Token Cost=11722026.06 | 0 | |
| CodeIEModel=Qwen-2.5-7b, Token Cost=11722026.06 | 0 | |
| CodeIEModel=Llama-3.1-8b, Token Cost=11722026.06 | 0 | |
| CodeIEModel=Pixtral-12B, Token Cost=11722026.06 | 0 |