Relation Extraction on SemEval
91.9Micro-F1SP
Evaluation Results
| Method | Links | |
|---|---|---|
| SP2024.04 | 91.9 | |
| ours2020.04 | 91 | |
| KLG2024.04 | 90.6 | |
| GAP2024.04 | 90.3 | |
| BERTEM-MTBArchitecture=PLM-based2020.04 | 89.5 | |
| CPSupervised training data percentage=100%, Input configuration=C+M2020.10 | 87.6 | |
| MTBSupervised training data percentage=100%, Input configuration=C+M2020.10 | 87.3 | |
| BERTSupervised training data percentage=100%, Input configuration=C+M2020.10 | 87.1 | |
| C-AGGCNArchitecture=GNN-based2020.04 | 85.7 | |
| Ours (mix-OBO)K=32, Base Model=RetrievalRE2025.05 | 84.01 | |
| RetrievalREK=322025.05 | 83.93 | |
| CPSupervised training data percentage=10%, Input configuration=C+M2020.10 | 82.2 | |
| RetrievalREK=162025.05 | 81.42 | |
| Ours (mix-AAO)K=32, Base Model=RetrievalRE2025.05 | 81.22 | |
| CPSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 81.1 | |
| KnowPromptK=322025.05 | 81.06 | |
| Ours (mix-OBO)K=16, Base Model=RetrievalRE2025.05 | 80.84 | |
| MTBSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 80.7 | |
| MTBSupervised training data percentage=10%, Input configuration=C+M2020.10 | 80.6 | |
| Ours (mix-AAO)K=32, Base Model=KnowPrompt2025.05 | 80.46 | |
| Ours (mix-OBO)K=32, Base Model=KnowPrompt2025.05 | 80.4 | |
| BERTSupervised training data percentage=100%, Input configuration=OnlyC2020.10 | 79.8 | |
| Ours (mix-AAO)K=16, Base Model=RetrievalRE2025.05 | 78.9 | |
| BERTSupervised training data percentage=10%, Input configuration=C+M2020.10 | 77.2 | |
| CPSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 76.6 | |
| Ours (mix-AAO)K=16, Base Model=KnowPrompt2025.05 | 76.36 | |
| Ours (mix-OBO)K=16, Base Model=KnowPrompt2025.05 | 75.36 | |
| MTBSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 74.4 | |
| Ours (mix-OBO)K=8, Base Model=RetrievalRE2025.05 | 74.2 | |
| KnowPromptK=162025.05 | 74.08 | |
| Ours (mix-AAO)K=8, Base Model=RetrievalRE2025.05 | 73.36 | |
| RetrievalREK=82025.05 | 72.53 | |
| Ours (mix-AAO)K=8, Base Model=KnowPrompt2025.05 | 70.32 | |
| BERTSupervised training data percentage=10%, Input configuration=OnlyC2020.10 | 68.8 | |
| MTBSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 68.2 | |
| Ours (mix-OBO)K=8, Base Model=KnowPrompt2025.05 | 67.92 | |
| CPSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 67.9 | |
| BERTSupervised training data percentage=100%, Input configuration=OnlyM2020.10 | 67.7 | |
| KnowPromptK=82025.05 | 61.39 | |
| MTBSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 54.3 | |
| CPSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 54.3 | |
| BERTSupervised training data percentage=10%, Input configuration=OnlyM2020.10 | 52.7 | |
| Ours (pure)K=32, Base Model=RetrievalRE2025.05 | 49.22 | |
| CPSupervised training data percentage=1%, Input configuration=C+M2020.10 | 48.2 | |
| Ours (pure)K=32, Base Model=KnowPrompt2025.05 | 47.7 | |
| Ours (pure)K=16, Base Model=RetrievalRE2025.05 | 47.2 | |
| CPSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 47 | |
| Ours (pure)K=8, Base Model=RetrievalRE2025.05 | 45.13 | |
| Ours (pure)K=16, Base Model=KnowPrompt2025.05 | 45.05 | |
| Ours (pure)K=8, Base Model=KnowPrompt2025.05 | 42.02 | |
| Ours (constant)K=16, Base Model=RetrievalRE2025.05 | 39.47 | |
| BERTSupervised training data percentage=1%, Input configuration=C+M2020.10 | 36.7 | |
| Ours (constant)K=8, Base Model=RetrievalRE2025.05 | 36.65 | |
| MTBSupervised training data percentage=1%, Input configuration=C+M2020.10 | 36.2 | |
| MTBSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 33 | |
| Ours (constant)K=16, Base Model=KnowPrompt2025.05 | 30.53 | |
| BERTSupervised training data percentage=1%, Input configuration=OnlyC2020.10 | 29.4 | |
| Direct-REPrompting=Direct LLM2025.05 | 25.55 | |
| MTBSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 24.9 | |
| BERTSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 24.5 | |
| RAG4REbackbone=Flan T5-XL2024.04 | 23.41 | |
| Ours (constant)K=8, Base Model=KnowPrompt2025.05 | 22.32 | |
| CPSupervised training data percentage=1%, Input configuration=OnlyM2020.10 | 22.1 |