Relationship Extraction on SemEval Task 8 2010 (test)
90.36F1 ScoreIndicator-aware BERT
Evaluation results
| Method | Links | |
|---|---|---|
| Indicator-aware BERT2019.12 | 90.36 | |
| Soares et al. (2019)LM=BERT_LARGE, MTB pretraining=true2019.09 | 89.5 | |
| R-BERT2019.12 | 89.25 | |
| Soares et al. (2019)LM=BERT_LARGE2019.09 | 89.2 | |
| KnowBert-W+WLM=BERT_BASE2019.09 | 89.1 | |
| Wang et al. (2019b)LM=BERT_BASE2019.09 | 89 | |
| Wang et al. (2016)2019.09 | 88 | |
| Attention CNNextra_features=POS, WN, WAN2019.12 | 85.9 | |
| C-AGGCN2019.06 | 85.7 | |
| Attention Bi-LSTM (Lee et al., 2019)extra_features=LET2019.12 | 85.2 | |
| C-GCN2019.06 | 84.8 | |
| Attention Bi-LSTM (Lee et al., 2019)2019.12 | 84.7 | |
| SPTree2019.06 | 84.4 | |
| Attention CNN2019.12 | 84.3 | |
| Bi-LSTMextra_features=POS, NER, DEP, WN2019.12 | 84.3 | |
| Hier Attention Bi-LSTM2019.12 | 84.3 | |
| CR-CNN2019.12 | 84.1 | |
| Attention Bi-LSTM (Zhou et al., 2016)2019.12 | 84 | |
| SDP-LSTM2019.06 | 83.7 | |
| CNNextra_features=WN2019.12 | 82.7 | |
| Bi-LSTM2019.12 | 82.7 | |
| PA-LSTM2019.06 | 82.7 | |
| SVM2019.06 | 82.2 | |
| CNN2019.12 | 78.9 |