Relation Extraction on CONLL04
78.84Relation Strict F1USM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| USM2023.04 | 78.84 | — | |
| InstructUIE2023.04 | 78.48 | — | |
| InstructUIE2023.04 | 76.65 | — | |
| UIEBackbone=T5-v1.1-large, Pre-training=Large-scale structure-text data2022.03 | 75 | — | |
| UIE2023.04 | 75 | — | |
| Wang and Lu (2020)Type=Comparable SOTA2022.03 | 73.6 | — | |
| UniEXNumber of Parameters=372M, Backbone=RoBERTa-large2023.05 | 73.4 | — | |
| SELBackbone=T5-v1.1-large, Pre-training=None2022.03 | 73.07 | — | |
| UIENumber of Parameters=770M, Backbone=T5-large2023.05 | 73.07 | — | |
| UniEXNumber of Parameters=132M, Backbone=RoBERTa-base2023.05 | 71.79 | — | |
| TANLNumber of Parameters=220M, Backbone=T5-base2023.05 | 71.4 | — | |
| HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 63.95 | 67.4 | |
| UIE-basedata_regime=10%2022.03 | 59.18 | — | |
| FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 57.47 | 62.91 | |
| UIE-base w/o SSIdata_regime=10%2022.03 | 56.59 | — | |
| UIE-basedata_regime=10-Shot2022.03 | 52.39 | — | |
| UIE-basedata_regime=5%2022.03 | 51.72 | — | |
| Fine-tuned T5-basedata_regime=10%2022.03 | 49.95 | — | |
| UIE-base w/o SSIdata_regime=10-Shot2022.03 | 49.47 | — | |
| UIE-base w/o SSIdata_regime=5%2022.03 | 48.7 | — | |
| UIE-basedata_regime=AVE-R2022.03 | 47.22 | — | |
| Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 45.61 | 48.3 | |
| UIE-basedata_regime=5-Shot2022.03 | 45.41 | — | |
| BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 43.62 | 45.96 | |
| UIE-base w/o SSIdata_regime=AVE-R2022.03 | 43.17 | — | |
| EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 42.09 | 45.67 | |
| T5-v1.1-basedata_regime=10%2022.03 | 41.87 | — | |
| Fine-tuned T5-basedata_regime=10-Shot2022.03 | 41.44 | — | |
| UIE-base w/o SSIdata_regime=5-Shot2022.03 | 40.35 | — | |
| UIE-basedata_regime=AVE-S2022.03 | 39.95 | — | |
| Fine-tuned T5-basedata_regime=5%2022.03 | 37.75 | — | |
| UIE-base w/o SSIdata_regime=AVE-S2022.03 | 34.34 | — | |
| Fine-tuned T5-basedata_regime=AVE-R2022.03 | 33.53 | — | |
| TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 32.83 | 36.08 | |
| T5-v1.1-basedata_regime=5%2022.03 | 32.38 | — | |
| UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 30.85 | 32.25 | |
| UIE-basedata_regime=1%2022.03 | 30.77 | — | |
| Fine-tuned T5-basedata_regime=5-Shot2022.03 | 28.16 | — | |
| DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 27.28 | 30.34 | |
| T5-v1.1-basedata_regime=AVE-R2022.03 | 26.78 | — | |
| DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Llama-3.1-8B-Instruct2026.04 | 26.6 | 29.8 | |
| T5-v1.1-basedata_regime=10-Shot2022.03 | 25.98 | — | |
| Fine-tuned T5-basedata_regime=AVE-S2022.03 | 24.61 | — | |
| UIE-base w/o SSIdata_regime=1%2022.03 | 24.21 | — | |
| UIE-basedata_regime=1-Shot2022.03 | 22.05 | — | |
| UIE-base w/o SSIdata_regime=1-Shot2022.03 | 13.21 | — | |
| Fine-tuned T5-basedata_regime=1%2022.03 | 12.89 | — | |
| T5-v1.1-basedata_regime=AVE-S2022.03 | 12.11 | — | |
| T5-v1.1-basedata_regime=5-Shot2022.03 | 7.99 | — | |
| T5-v1.1-basedata_regime=1%2022.03 | 6.08 | — | |
| Fine-tuned T5-basedata_regime=1-Shot2022.03 | 4.24 | — | |
| T5-v1.1-basedata_regime=1-Shot2022.03 | 2.35 | — |