Relation Triple Extraction on WebNLG original (test)
94.7F1 Score (%)UniRel
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| UniRel2022.11 | 94.7 | 94.8 | 94.6 | |
| OneRelBackbone=BERT2022.11 | 94.3 | 94.1 | 94.4 | |
| GRTEBackbone=BERT2022.11 | 93.9 | 93.7 | 94.2 | |
| UniRelVariant=separate2022.11 | 93.9 | 93.5 | 94.4 | |
| PFN2022.11 | 93.6 | — | — | |
| R-BPtrNetBackbone=BERT2022.11 | 93.3 | 93.7 | 92.8 | |
| TDEERBackbone=BERT2022.11 | 93.1 | 93.8 | 92.4 | |
| PRGCBackbone=BERT2022.11 | 93 | 94 | 92.1 | |
| EmRel2022.11 | 92.9 | 92.7 | 93 | |
| TPlinkerBackbone=BERT2022.11 | 91.9 | 91.7 | 92 | |
| CASRELbackbone=BERT, initialization=pre-trained weights2019.09 | 91.8 | 93.4 | 90.1 | |
| CasRelBackbone=BERT2022.11 | 91.8 | 93.4 | 90.1 | |
| CASREL_LSTMbackbone=LSTM, initialization=GloVe2019.09 | 83.7 | 86.9 | 80.6 | |
| ETL-Span2019.09 | 83.1 | 84.3 | 82 | |
| ETL-BIES2019.09 | 82.3 | 83.5 | 81.1 | |
| CASREL_randombackbone=BERT, initialization=random2019.09 | 82 | 84.7 | 79.5 | |
| UniRelVariant=unused2022.11 | 71.7 | 75.1 | 68.6 | |
| OrderRLreported_in_other_works=†2019.09 | 61.6 | 63.3 | 59.9 | |
| CopyR_RL2019.09 | 61.6 | 63.3 | 59.9 | |
| OrderCopyRE2022.11 | 61.6 | 63.3 | 59.9 | |
| CopyR_RLre-implementation=true2019.09 | 61 | 60.9 | 61.1 | |
| MultiHeadofficial_implementation=*2019.09 | 55.7 | 57.5 | 54.1 | |
| GraphRelreported_in_other_works=†2019.09 | 42.9 | 44.7 | 41.1 | |
| GraphRel_2ppasses=2p2019.09 | 42.9 | 44.7 | 41.1 | |
| GraphRel2022.11 | 42.9 | 44.7 | 41.1 | |
| GraphRel_1ppasses=1p2019.09 | 40.7 | 42.3 | 39.2 | |
| MultiDecoderquoted_from_paper=‡2019.09 | 37.1 | 37.7 | 36.4 | |
| CopyR_Multi_Decoderdecoder_structure=multi-decoder2019.09 | 37.1 | 37.7 | 36.4 | |
| CopyRE2022.11 | 37.1 | 37.7 | 36.4 | |
| CopyR_One_Decoderdecoder_structure=one-decoder2019.09 | 30.5 | 32.2 | 28.9 | |
| NovelTaggingreported_in_other_works=†2019.09 | 28.3 | 52.5 | 19.3 | |
| NovelTagging2019.09 | 28.3 | 52.5 | 19.3 | |
| NovelTagging2022.11 | 28.3 | 52.5 | 19.3 |