Relation Extraction on TACRED v1.0 (test)
91.1F1 ScoreRoBERTa_LARGE + typed entity marker (punct)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RoBERTa_LARGE + typed entity marker (punct)Backbone=RoBERTa-Large, Entity Representation=typed entity marker (punct)2021.02 | 91.1 | — | — | |
| RoBERTa_LARGE + entity markerBackbone=RoBERTa-Large, Entity Representation=entity marker2021.02 | 90.5 | — | — | |
| LUKEBackbone=LUKE2021.02 | 90.3 | — | — | |
| BERT_LARGE + typed entity markerBackbone=BERT-Large, Entity Representation=typed entity marker2021.02 | 89.7 | — | — | |
| BERT_LARGE + entity markerBackbone=BERT-Large, Entity Representation=entity marker2021.02 | 89.2 | — | — | |
| BERT_BASE + typed entity markerBackbone=BERT-Base, Entity Representation=typed entity marker2021.02 | 87.9 | — | — | |
| BERT_BASE + entity markerBackbone=BERT-Base, Entity Representation=entity marker2021.02 | 87.7 | — | — | |
| SpanBERTBackbone=SpanBERT2021.02 | 85.3 | — | — | |
| RoBERTa_LARGE + typed entity marker (punct)Backbone=RoBERTa-Large, Entity Representation=typed entity marker (punct)2021.02 | 83.2 | — | — | |
| BERT_LARGE + typed entity markerBackbone=BERT-Large, Entity Representation=typed entity marker2021.02 | 81.3 | — | — | |
| RoBERTa_LARGE + entity markerBackbone=RoBERTa-Large, Entity Representation=entity marker2021.02 | 81.2 | — | — | |
| LUKEBackbone=LUKE2021.02 | 80.6 | — | — | |
| C-GCNArchitecture=Sequence-based2021.02 | 80.3 | — | — | |
| PA-LSTMArchitecture=Sequence-based2021.02 | 79.4 | — | — | |
| KnowBERTBackbone=KnowBERT2021.02 | 79.3 | — | — | |
| BERT_BASE + typed entity markerBackbone=BERT-Base, Entity Representation=typed entity marker2021.02 | 79.3 | — | — | |
| SpanBERTBackbone=SpanBERT2021.02 | 78 | — | — | |
| BERT_LARGE + entity markerBackbone=BERT-Large, Entity Representation=entity marker2021.02 | 77.9 | — | — | |
| BERT_BASE + entity markerBackbone=BERT-Base, Entity Representation=entity marker2021.02 | 77.2 | — | — | |
| C-GCNArchitecture=Sequence-based2021.02 | 74.6 | — | — | |
| PA-LSTMArchitecture=Sequence-based2021.02 | 73.3 | — | — | |
| SimpleREBackbone=BERT2020.12 | 71.7 | — | — | |
| KnowBERTKnowledge Source=External Knowledge Base2020.12 | 71.5 | — | — | |
| SpanBERT2020.12 | 70.8 | — | — | |
| GDPNetBackbone=SpanBERT2020.12 | 70.5 | — | — | |
| LST-AGCN2020.12 | 68.8 | — | — | |
| C-AGGCN2020.12 | 68.2 | — | — | |
| PLMsupervision=Supervised, training_data=100%2022.03 | 66.9 | 66.3 | 67.6 | |
| PA-LSTM2020.12 | 65.1 | — | — | |
| LSTM2020.12 | 62.7 | — | — | |
| PRBOOSTsupervision=Weakly Supervised2022.03 | 48.1 | 42.7 | 55.1 | |
| COSINEsupervision=Weakly Supervised, fine-tuning=on clean data2022.03 | 41 | 40.4 | 41.7 | |
| Snorkelsupervision=Weakly Supervised, fine-tuning=on clean data2022.03 | 40.8 | 41 | 40.6 | |
| Snorkelsupervision=Weakly Supervised2022.03 | 39.7 | 39.2 | 40.1 | |
| COSINEsupervision=Weakly Supervised2022.03 | 39.5 | 38.9 | 40.3 | |
| PLMsupervision=Supervised, training_data=limited2022.03 | 32.9 | 40.8 | 27.6 | |
| Rule Matchingsupervision=Weakly Supervised2022.03 | 20.1 | 85 | 11.4 |