Relation Extraction on TACRED-Revisit
37.26Micro F1RetrievalRE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RetrievalREK=322025.05 | 37.26 | — | — | — | |
| Ours (mix-OBO)K=32, Base Model=RetrievalRE2025.05 | 36.9 | — | — | — | |
| Ours (mix-AAO)K=32, Base Model=RetrievalRE2025.05 | 36.77 | — | — | — | |
| Ours (mix-AAO)K=32, Base Model=KnowPrompt2025.05 | 35.65 | — | — | — | |
| Ours (mix-AAO)K=16, Base Model=RetrievalRE2025.05 | 35.64 | — | — | — | |
| Ours (mix-OBO)K=32, Base Model=KnowPrompt2025.05 | 35.27 | — | — | — | |
| Ours (mix-AAO)K=8, Base Model=RetrievalRE2025.05 | 35.06 | — | — | — | |
| Ours (mix-AAO)K=16, Base Model=KnowPrompt2025.05 | 34.77 | — | — | — | |
| KnowPromptK=322025.05 | 34.61 | — | — | — | |
| Ours (mix-OBO)K=16, Base Model=KnowPrompt2025.05 | 34.39 | — | — | — | |
| Ours (mix-OBO)K=8, Base Model=KnowPrompt2025.05 | 34.33 | — | — | — | |
| Ours (mix-AAO)K=8, Base Model=KnowPrompt2025.05 | 34.15 | — | — | — | |
| Ours (mix-OBO)K=16, Base Model=RetrievalRE2025.05 | 34.15 | — | — | — | |
| Ours (mix-OBO)K=8, Base Model=RetrievalRE2025.05 | 33.81 | — | — | — | |
| RetrievalREK=162025.05 | 32.34 | — | — | — | |
| Ours (pure)K=16, Base Model=RetrievalRE2025.05 | 31.73 | — | — | — | |
| Ours (pure)K=32, Base Model=RetrievalRE2025.05 | 31.51 | — | — | — | |
| Ours (pure)K=32, Base Model=KnowPrompt2025.05 | 31.12 | — | — | — | |
| KnowPromptK=162025.05 | 30.76 | — | — | — | |
| Data GenerationK=32, Base Model=KnowPrompt2025.05 | 29.8 | — | — | — | |
| Data GenerationK=32, Base Model=RetrievalRE2025.05 | 29.48 | — | — | — | |
| Ours (pure)K=16, Base Model=KnowPrompt2025.05 | 29.25 | — | — | — | |
| RetrievalREK=82025.05 | 28.95 | — | — | — | |
| Ours (pure)K=8, Base Model=RetrievalRE2025.05 | 28.55 | — | — | — | |
| Data GenerationK=16, Base Model=RetrievalRE2025.05 | 28.46 | — | — | — | |
| Data GenerationK=16, Base Model=KnowPrompt2025.05 | 27.89 | — | — | — | |
| Data GenerationK=8, Base Model=RetrievalRE2025.05 | 27.67 | — | — | — | |
| Ours (constant)K=16, Base Model=RetrievalRE2025.05 | 26.38 | — | — | — | |
| KnowPromptK=82025.05 | 26.31 | — | — | — | |
| Ours (constant)K=8, Base Model=RetrievalRE2025.05 | 23.99 | — | — | — | |
| Data GenerationK=8, Base Model=KnowPrompt2025.05 | 23.14 | — | — | — | |
| Ours (pure)K=8, Base Model=KnowPrompt2025.05 | 23.04 | — | — | — | |
| Ours (constant)K=16, Base Model=KnowPrompt2025.05 | 22.22 | — | — | — | |
| Direct-REPrompting=Direct LLM2025.05 | 21.82 | — | — | — | |
| Ours (constant)K=8, Base Model=KnowPrompt2025.05 | 18.39 | — | — | — | |
| C-AGGCNresults_obtained_by=released code run by authors2020.12 | — | 77.7 | 73.4 | 75.5 | |
| GDPNet2020.12 | — | 79.4 | 81 | 80.2 | |
| KnowBERT2020.12 | — | — | — | 79.3 | |
| LSTMresults_obtained_by=released code run by authors2020.12 | — | 71.5 | 69.7 | 70.6 | |
| PA-LSTMresults_obtained_by=released code run by authors2020.12 | — | 74.5 | 74.1 | 74.3 | |
| SpanBERTresults_obtained_by=released code run by authors2020.12 | — | 75.7 | 80.7 | 78 |