Relation Extraction on Geo-NRE
71.24PrecisionTransformer (+triplet classifier)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Transformer (+triplet classifier)component=triplet classifier2021.12 | 71.24 | 57.61 | 63.7 | |
| Single Attention (+triplet classifier)component=triplet classifier2021.12 | 67.04 | 53.01 | 59.21 | |
| GenIEdescription=Our pipeline baseline2021.12 | 64.6 | 64.05 | 64.32 | |
| Transformer (+beam)decoding=beam search2021.12 | 61.81 | 61.61 | 61.71 | |
| Single Attention (+beam)decoding=beam search2021.12 | 58.69 | 48.51 | 53.12 | |
| Transformer (+pre-trained)pre-training=true2021.12 | 48.41 | 48.31 | 48.36 | |
| Transformerarchitecture=Encoder-decoder2021.12 | 45.75 | 46.2 | 45.97 | |
| Single Attention (+pre-trained)pre-training=true2021.12 | 43.14 | 43.11 | 43.12 | |
| Single Attentionarchitecture=Encoder-decoder2021.12 | 40.1 | 39.12 | 39.6 | |
| NeuralEL + CNNner_ed_system=NeuralEL, re_system=CNN2021.12 | 37.81 | 30.05 | 33.49 | |
| AIDA + CNNner_ed_system=AIDA, re_system=CNN2021.12 | 37.15 | 31.65 | 34.18 | |
| NeuralEL + MinIEner_ed_system=NeuralEL, re_system=MinIE2021.12 | 36.44 | 38.11 | 37.26 | |
| AIDA + MinIEner_ed_system=AIDA, re_system=MinIE2021.12 | 35.74 | 39.01 | 37.3 | |
| NeuralEL + ClauseIEner_ed_system=NeuralEL, re_system=ClauseIE2021.12 | 35.63 | 37.91 | 36.73 | |
| AIDA + ClauseIEner_ed_system=AIDA, re_system=ClauseIE2021.12 | 35.31 | 39.51 | 37.29 |