Document-level Relation Extraction on DocRED 1.0 (test)
63.89F1CGM2IR-RoBERTa_large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CGM2IR-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 63.89 | 61.96 | |
| ATLOP-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 63.4 | 61.39 | |
| GAIN-BERT_largeBackbone=BERT-large, Model Category=Non-graph-based2022.01 | 62.76 | 60.31 | |
| GAIN + SIEFBackbone=BERTbase2022.04 | 62.29 | 59.87 | |
| CGM2IR-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 62.06 | 60.24 | |
| SIRE-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 62.05 | 60.18 | |
| DocuNet-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 61.86 | 59.93 | |
| DocuNetBackbone=BERTbase2022.04 | 61.86 | 59.93 | |
| MRN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 61.74 | 59.52 | |
| SSAN-RoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 61.42 | 59.47 | |
| DRE-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 61.37 | 59.15 | |
| DRNBackbone=BERTbase2022.04 | 61.37 | 59.15 | |
| ATLOP-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 61.3 | 59.31 | |
| ATLOPBackbone=BERTbase2022.04 | 61.3 | 59.31 | |
| GAIN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 61.24 | 59 | |
| GAINBackbone=BERTbase2022.04 | 61.24 | 59 | |
| HeterGSAN + SIEFBackbone=BERTbase2022.04 | 60.02 | 57.93 | |
| CorefRoBERTa_largeBackbone=RoBERTa-large, Model Category=Non-graph-based2022.01 | 59.91 | 57.68 | |
| HeterGSAN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 59.45 | 57.12 | |
| ReconstructorBackbone=BERTbase2022.04 | 59.45 | 57.12 | |
| LSR-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 59.05 | 56.97 | |
| LSRBackbone=BERTbase2022.04 | 59.05 | 56.97 | |
| BERTbase + SIEFBackbone=BERTbase2022.04 | 58.93 | 57.87 | |
| BERT_largeBackbone=BERT-large, Model Category=Non-graph-based2022.01 | 58.69 | 56.47 | |
| HeterGSANBackbone=BERTbase2022.04 | 58.54 | 56.21 | |
| SSAN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 58.16 | 55.84 | |
| GLRE-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 57.4 | 55.4 | |
| CorefBERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 56.96 | 54.54 | |
| GAIN + SIEFBackbone=GloVe2022.04 | 56.75 | 54.72 | |
| GCGCN-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 56.67 | 54.53 | |
| DRNBackbone=GloVe2022.04 | 56.33 | 54.35 | |
| BERTbaseBackbone=BERTbase2022.04 | 56.27 | 53.93 | |
| HeterGSAN + SIEFBackbone=GloVe2022.04 | 55.85 | 53.94 | |
| GEDA-BERT_baseBackbone=BERT-base, Model Category=Graph-based2022.01 | 55.74 | 53.71 | |
| HIN-BERTEmbedding=BERT (768d)2020.03 | 55.6 | 53.7 | |
| HIN-BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 55.6 | 53.7 | |
| ReconstructorBackbone=GloVe2022.04 | 55.13 | 53.25 | |
| GAINBackbone=GloVe2022.04 | 55.08 | 52.66 | |
| LSRBackbone=GloVe2022.04 | 54.18 | 52.15 | |
| BERT-Two-StepBackbone=BERT, Strategy=Two-step2020.03 | 53.92 | — | |
| Two-PhaseBackbone=BERTbase2022.04 | 53.92 | — | |
| HeterGSANBackbone=GloVe2022.04 | 53.52 | 52.07 | |
| HIN-GloVeEmbedding=GloVe (100d)2020.03 | 53.3 | 51.15 | |
| BiLSTM + SIEFBackbone=GloVe2022.04 | 53.22 | 51.03 | |
| BERT-REBackbone=BERT2020.03 | 53.2 | — | |
| BERT_baseBackbone=BERT-base, Model Category=Non-graph-based2022.01 | 53.2 | — | |
| BILSTM-REBackbone=BiLSTM2020.03 | 51.06 | 48.78 | |
| BiLSTMBackbone=GloVe2022.04 | 51.06 | 48.78 | |
| Context-AwareBackbone=LSTM2020.03 | 50.7 | 48.4 | |
| LSTM-REBackbone=LSTM2020.03 | 50.07 | 47.71 | |
| CNN-REBackbone=CNN2020.03 | 42.26 | 40.33 |