List your company
ResearchFormerly WizWand

Relation Extraction on SemEval

91.9Micro-F1SP
19.30838.1545775.846Apr 8, 2020Feb 14, 2021Dec 24, 2021Nov 2, 2022Sep 11, 2023Jul 20, 2024May 29, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SP2024.0491.9
ours2020.0491
KLG2024.0490.6
GAP2024.0490.3
BERTEM-MTBArchitecture=PLM-based2020.0489.5
CPSupervised training data percentage=100%, Input configuration=C+M2020.1087.6
MTBSupervised training data percentage=100%, Input configuration=C+M2020.1087.3
BERTSupervised training data percentage=100%, Input configuration=C+M2020.1087.1
C-AGGCNArchitecture=GNN-based2020.0485.7
Ours (mix-OBO)K=32, Base Model=RetrievalRE2025.0584.01
RetrievalREK=322025.0583.93
CPSupervised training data percentage=10%, Input configuration=C+M2020.1082.2
RetrievalREK=162025.0581.42
Ours (mix-AAO)K=32, Base Model=RetrievalRE2025.0581.22
CPSupervised training data percentage=100%, Input configuration=OnlyC2020.1081.1
KnowPromptK=322025.0581.06
Ours (mix-OBO)K=16, Base Model=RetrievalRE2025.0580.84
MTBSupervised training data percentage=100%, Input configuration=OnlyC2020.1080.7
MTBSupervised training data percentage=10%, Input configuration=C+M2020.1080.6
Ours (mix-AAO)K=32, Base Model=KnowPrompt2025.0580.46
Ours (mix-OBO)K=32, Base Model=KnowPrompt2025.0580.4
BERTSupervised training data percentage=100%, Input configuration=OnlyC2020.1079.8
Ours (mix-AAO)K=16, Base Model=RetrievalRE2025.0578.9
BERTSupervised training data percentage=10%, Input configuration=C+M2020.1077.2
CPSupervised training data percentage=10%, Input configuration=OnlyC2020.1076.6
Ours (mix-AAO)K=16, Base Model=KnowPrompt2025.0576.36
Ours (mix-OBO)K=16, Base Model=KnowPrompt2025.0575.36
MTBSupervised training data percentage=10%, Input configuration=OnlyC2020.1074.4
Ours (mix-OBO)K=8, Base Model=RetrievalRE2025.0574.2
KnowPromptK=162025.0574.08
Ours (mix-AAO)K=8, Base Model=RetrievalRE2025.0573.36
RetrievalREK=82025.0572.53
Ours (mix-AAO)K=8, Base Model=KnowPrompt2025.0570.32
BERTSupervised training data percentage=10%, Input configuration=OnlyC2020.1068.8
MTBSupervised training data percentage=100%, Input configuration=OnlyM2020.1068.2
Ours (mix-OBO)K=8, Base Model=KnowPrompt2025.0567.92
CPSupervised training data percentage=100%, Input configuration=OnlyM2020.1067.9
BERTSupervised training data percentage=100%, Input configuration=OnlyM2020.1067.7
KnowPromptK=82025.0561.39
MTBSupervised training data percentage=10%, Input configuration=OnlyM2020.1054.3
CPSupervised training data percentage=10%, Input configuration=OnlyM2020.1054.3
BERTSupervised training data percentage=10%, Input configuration=OnlyM2020.1052.7
Ours (pure)K=32, Base Model=RetrievalRE2025.0549.22
CPSupervised training data percentage=1%, Input configuration=C+M2020.1048.2
Ours (pure)K=32, Base Model=KnowPrompt2025.0547.7
Ours (pure)K=16, Base Model=RetrievalRE2025.0547.2
CPSupervised training data percentage=1%, Input configuration=OnlyC2020.1047
Ours (pure)K=8, Base Model=RetrievalRE2025.0545.13
Ours (pure)K=16, Base Model=KnowPrompt2025.0545.05
Ours (pure)K=8, Base Model=KnowPrompt2025.0542.02
Ours (constant)K=16, Base Model=RetrievalRE2025.0539.47
BERTSupervised training data percentage=1%, Input configuration=C+M2020.1036.7
Ours (constant)K=8, Base Model=RetrievalRE2025.0536.65
MTBSupervised training data percentage=1%, Input configuration=C+M2020.1036.2
MTBSupervised training data percentage=1%, Input configuration=OnlyC2020.1033
Ours (constant)K=16, Base Model=KnowPrompt2025.0530.53
BERTSupervised training data percentage=1%, Input configuration=OnlyC2020.1029.4
Direct-REPrompting=Direct LLM2025.0525.55
MTBSupervised training data percentage=1%, Input configuration=OnlyM2020.1024.9
BERTSupervised training data percentage=1%, Input configuration=OnlyM2020.1024.5
RAG4REbackbone=Flan T5-XL2024.0423.41
Ours (constant)K=8, Base Model=KnowPrompt2025.0522.32
CPSupervised training data percentage=1%, Input configuration=OnlyM2020.1022.1