Relation Extraction on Wiki-NRE
82.2PrecisionDIAL-KG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DIAL-KGMode=Batch2026.03 | 82.2 | 88.7 | 85.3 | |
| DIAL-KGMode=Stream-End2026.03 | 81.4 | 87.6 | 84.4 | |
| AutoKGMode=baseline2026.03 | 79.2 | 84 | 81.5 | |
| EDCMode=baseline2026.03 | 78.4 | 83.3 | 80.8 | |
| Single Attention (+triplet classifier)architecture=Encoder-decoder baseline, component=triplet classifier2021.12 | 73.78 | 50.13 | 59.7 | |
| Transformer (+triplet classifier)architecture=Encoder-decoder baseline, component=triplet classifier2021.12 | 73.07 | 48.66 | 58.42 | |
| GenIEdescription=Our pipeline baseline2021.12 | 67.43 | 54.22 | 60.11 | |
| Single Attention (+beam)architecture=Encoder-decoder baseline, decoding=beam search2021.12 | 60.56 | 52.31 | 56.13 | |
| Transformer (+beam)architecture=Encoder-decoder baseline, decoding=beam search2021.12 | 58.29 | 50.25 | 53.97 | |
| Transformer (+pre-trained)architecture=Encoder-decoder baseline, pre-training=true2021.12 | 47.48 | 40.91 | 43.95 | |
| Single Attention (+pre-trained)architecture=Encoder-decoder baseline, pre-training=true2021.12 | 47.25 | 40.53 | 43.63 | |
| Transformerarchitecture=Encoder-decoder baseline2021.12 | 46.28 | 38.97 | 42.31 | |
| Single Attentionarchitecture=Encoder-decoder baseline2021.12 | 45.91 | 38.36 | 41.8 | |
| AIDA + CNNpipeline_type=baseline, ner_ed_system=AIDA, re_system=CNN2021.12 | 40.35 | 35.03 | 37.5 | |
| NeuralEL + CNNpipeline_type=baseline, ner_ed_system=NeuralEL, re_system=CNN2021.12 | 36.89 | 35.21 | 36.03 | |
| AIDA + MinIEpipeline_type=baseline, ner_ed_system=AIDA, re_system=MinIE2021.12 | 36.72 | 48.56 | 41.82 | |
| AIDA + ClauseIEpipeline_type=baseline, ner_ed_system=AIDA, re_system=ClauseIE2021.12 | 36.17 | 47.28 | 40.99 | |
| NeuralEL + MinIEpipeline_type=baseline, ner_ed_system=NeuralEL, re_system=MinIE2021.12 | 35.11 | 39.67 | 37.25 | |
| NeuralEL + ClauseIEpipeline_type=baseline, ner_ed_system=NeuralEL, re_system=ClauseIE2021.12 | 34.45 | 37.86 | 36.07 |