Document-level Relation Extraction on DocRED 1.0 (dev)
62.24F1GAIN + SIEF
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GAIN + SIEFBackbone=BERTbase2022.04 | 62.24 | 59.82 | |
| DocuNetBackbone=BERTbase2022.04 | 61.83 | 59.86 | |
| DRNBackbone=BERTbase2022.04 | 61.39 | 59.33 | |
| GAINBackbone=BERTbase2022.04 | 61.22 | 59.14 | |
| ATLOPBackbone=BERTbase2022.04 | 61.09 | 59.22 | |
| ReconstructorBackbone=BERTbase2022.04 | 60.18 | 58.13 | |
| HeterGSAN + SIEFBackbone=BERTbase2022.04 | 60.04 | 57.99 | |
| HeterGSANBackbone=BERTbase2022.04 | 59.13 | 57 | |
| BERTbase + SIEFBackbone=BERTbase2022.04 | 59.11 | 57.13 | |
| LSRBackbone=BERTbase2022.04 | 59 | 52.43 | |
| GAIN + SIEFBackbone=GloVe2022.04 | 56.96 | 55.07 | |
| BERTbaseBackbone=BERTbase2022.04 | 56.77 | 54.63 | |
| DRNBackbone=GloVe2022.04 | 56.49 | 54.61 | |
| HeterGSAN + SIEFBackbone=GloVe2022.04 | 56.3 | 54.49 | |
| ReconstructorBackbone=GloVe2022.04 | 55.7 | 54.25 | |
| GAINBackbone=GloVe2022.04 | 55.29 | 53.05 | |
| LSRBackbone=GloVe2022.04 | 55.17 | 48.82 | |
| Two-PhaseBackbone=BERTbase2022.04 | 54.42 | — | |
| HeterGSANBackbone=GloVe2022.04 | 54.4 | 52.17 | |
| BiLSTM + SIEFBackbone=GloVe2022.04 | 54.2 | 52.08 | |
| BiLSTMBackbone=GloVe2022.04 | 50.94 | 48.87 | |
| CGM2IR-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 0.6395 | 0.6203 | |
| ATLOP-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 0.6318 | 0.6132 | |
| GAIN-BERT_largeBackbone=BERT-large, Model Category=Non-graph-based2022.01 | 0.6309 | 0.6087 | |
| SSAN-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 0.6208 | 0.6025 | |
| CGM2IR-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.6201 | 0.6002 | |
| DocuNet-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.6183 | 0.5986 | |
| MRN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.6161 | 0.5974 | |
| SIRE-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.616 | 0.5982 | |
| DRE-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.6139 | 0.5933 | |
| GAIN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.6122 | 0.5914 | |
| ATLOP-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.6109 | 0.5922 | |
| HeterGSAN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.6018 | 0.5813 | |
| CorefRoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 0.5993 | 0.5784 | |
| SSAN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.5919 | 0.5703 | |
| LSR-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.59 | 0.5243 | |
| BERT_largeBackbone=BERT-large, Model Category=Non-graph-based2022.01 | 0.5883 | 0.5667 | |
| CorefBERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.5751 | 0.5532 | |
| GCGCN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.5735 | 0.5543 | |
| HIN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.5631 | 0.5429 | |
| GEDA-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 0.5616 | 0.5452 | |
| BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 0.5416 | — |