Document-level Relation Extraction on DocRED (dev)
63.18F1 ScoreROBERTa-ATLOP_LARGE
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ROBERTa-ATLOP_LARGEBackbone=ROBERTa-Large2020.10 | 63.18 | 61.32 | — | — | — | — | — | — | — | |
| GAIN-BERTlargePre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 63.09 | 60.87 | — | — | 61.79 | 64.75 | — | — | — | |
| DRE-MIR-BERTBackbone=BERT-base2022.04 | 62.81 | 60.85 | 68.67 | 56.09 | — | — | — | — | — | |
| CFER-RoBERTa_LargeBackbone=RoBERTa-Large2020.12 | 62.8 | 60.91 | — | — | — | — | — | — | — | |
| HCRE2026.04 | 62.8 | 61.22 | — | — | — | — | — | — | — | |
| Dense-CCNet-BERTbasebackbone=BERT-base2022.03 | 62.74 | 60.72 | — | — | — | — | — | — | — | |
| AFLKDBackbone=BERT-base-cased2022.05 | 62.03 | 60.08 | — | — | — | — | — | — | — | |
| DREEAMBackbone=RoBERTa, Distant Data=DOREMI2026.01 | 61.94 | 53.67 | — | — | — | — | 59.04 | 65.13 | 45.64 | |
| DREEAMBackbone=RoBERTa, Distant Data=D+U2026.01 | 61.87 | 52.89 | — | — | — | — | 60.9 | 62.87 | 45.64 | |
| DocuNet-BERTbasebackbone=BERT-base2022.03 | 61.83 | 59.86 | — | — | — | — | — | — | — | |
| DocuNetBackbone=BERT-base-cased2022.05 | 61.83 | 59.86 | — | — | — | — | — | — | — | |
| DocuNet-BERTBackbone=BERT-base2022.04 | 61.83 | 59.86 | — | — | — | — | — | — | — | |
| ERACLBackbone=BERT-base-cased2022.05 | 61.8 | 59.72 | — | — | — | — | — | — | — | |
| SIRE-BERTpre-training=BERT2021.06 | 61.6 | 59.82 | 68.07 | 54.01 | — | — | — | — | — | |
| SIRE-BERTBackbone=BERT-base2022.04 | 61.6 | 59.82 | 68.07 | 54.01 | — | — | — | — | — | |
| DREEAMBackbone=RoBERTa, Distant Data=UGDRE2026.01 | 61.51 | 51.95 | — | — | — | — | 58.53 | 64.81 | 43.35 | |
| CFER-BERT_BaseBackbone=BERT-Base2020.12 | 61.41 | 59.23 | — | — | — | — | — | — | — | |
| DRN+BERT_baseBackbone=BERT-base2021.06 | 61.39 | 59.33 | — | — | — | — | — | — | — | |
| DRNBackbone=BERT-base-cased2022.05 | 61.39 | 59.33 | — | — | — | — | — | — | — | |
| ERABackbone=BERT-base-cased2022.05 | 61.3 | 59.3 | — | — | — | — | — | — | — | |
| Vanilla2026.04 | 61.3 | 60.21 | — | — | — | — | — | — | — | |
| GAIN-BERTbasePre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 61.22 | 59.14 | — | — | 57.76 | 60.96 | — | — | — | |
| GAIN+BERT_baseBackbone=BERT-base2021.06 | 61.22 | 59.14 | — | — | — | — | — | — | — | |
| GAIN-BERTpre-training=BERT2021.06 | 61.22 | 59.14 | 67.1 | 53.9 | — | — | — | — | — | |
| GAIN-BERT_BaseBackbone=BERT-Base2020.12 | 61.22 | 59.14 | — | — | — | — | — | — | — | |
| GAIN-BERTbasebackbone=BERT-base2022.03 | 61.22 | 59.14 | — | — | — | — | — | — | — | |
| GAINBackbone=BERT-base-cased2022.05 | 61.22 | 59.14 | — | — | — | — | — | — | — | |
| GAIN-BERTBackbone=BERT-base2022.04 | 61.22 | 59.14 | 67.1 | 53.9 | — | — | — | — | — | |
| BERT-ATLOP_BASEBackbone=BERT-Base2020.10 | 61.09 | 59.22 | — | — | — | — | — | — | — | |
| ATLOP-BERT_baseBackbone=BERT-base2021.06 | 61.09 | 59.22 | — | — | — | — | — | — | — | |
| ATLOP-BERTbasebackbone=BERT-base2022.03 | 61.09 | 59.22 | — | — | — | — | — | — | — | |
| ATLOPBackbone=BERT-base-cased2022.05 | 61.09 | 59.22 | — | — | — | — | — | — | — | |
| ATLOP-BERTBackbone=BERT-base2022.04 | 61.09 | 59.22 | — | — | — | — | — | — | — | |
| ATLOPBackbone=RoBERTa, Distant Data=D+U2026.01 | 60.61 | 50.09 | — | — | — | — | 56.57 | 65.28 | 40.63 | |
| DREEAMBackbone=BERT, Distant Data=D+U2026.01 | 60.49 | 51.9 | — | — | — | — | 61.08 | 59.91 | 45.78 | |
| DREEAMBackbone=BERT, Distant Data=DOREMI2026.01 | 60.39 | 52.18 | — | — | — | — | 57.65 | 63.41 | 44.33 | |
| DREEAMBackbone=BERT, Distant Data=UGDRE2026.01 | 60.25 | 51.02 | — | — | — | — | 59.15 | 61.38 | 43.66 | |
| HeterGSAN-Rec+BERT_baseBackbone=BERT-base2021.06 | 60.18 | 58.13 | — | — | — | — | — | — | — | |
| HeterGSAN-Recon-BERT_BaseBackbone=BERT-Base2020.12 | 60.18 | 58.13 | — | — | — | — | — | — | — | |
| HeterGSAN-BERTbasebackbone=BERT-base2022.03 | 60.18 | 58.13 | — | — | — | — | — | — | — | |
| HeterGSAN-BERTBackbone=BERT-base2022.04 | 60.18 | 58.13 | — | — | — | — | — | — | — | |
| MIUKrepresentation=three-view2021.04 | 60.11 | 58.27 | — | — | — | — | — | — | — | |
| MIUKBackbone=BERT-Base2020.12 | 60.11 | 58.27 | — | — | — | — | — | — | — | |
| ATLOPBackbone=RoBERTa, Distant Data=DOREMI2026.01 | 60.06 | 51.98 | — | — | — | — | 57.88 | 62.42 | 44.53 | |
| CorefROBERTa-REPre-trained=true, Backbone=ROBERTa, Model Scale=large2020.09 | 59.93 | 57.84 | — | — | — | — | — | — | — | |
| CorefRoBERTa_LargeBackbone=RoBERTa-Large2020.12 | 59.93 | 57.84 | — | — | — | — | — | — | — | |
| ATLOPBackbone=RoBERTa, Distant Data=UGDRE2026.01 | 59.92 | 48.34 | — | — | — | — | 53.5 | 68.1 | 37.46 | |
| ATLOPBackbone=BERT, Distant Data=D+U2026.01 | 59.8 | 48.74 | — | — | — | — | 56 | 64.16 | 39.3 | |
| ATLOPBackbone=BERT, Distant Data=UGDRE2026.01 | 59.67 | 47.83 | — | — | — | — | 53.62 | 67.25 | 37.11 | |
| CorefROBERTa_LARGEBackbone=ROBERTa-Large, Pre-training=CorefROBERTa2020.10 | 59.43 | 57.35 | — | — | — | — | — | — | — | |
| ATLOPBackbone=BERT, Distant Data=DOREMI2026.01 | 59.33 | 51.23 | — | — | — | — | 57.22 | 61.6 | 43.84 | |
| SSAN+RSMANbackbone=SSAN, plugin=RSMAN2022.05 | 59.25 | 57.22 | — | — | — | — | — | — | — | |
| ROBERTa-REPre-trained=true, Backbone=ROBERTa, Model Scale=large2020.09 | 59.22 | 57.14 | — | — | — | — | — | — | — | |
| SSANBackbone=BERT-base-cased2022.05 | 59.19 | 57.04 | — | — | — | — | — | — | — | |
| LSRbackbone=BERT2020.05 | 59 | 52.43 | 65.26 | 52.05 | — | — | — | — | — | |
| LSR-BERTPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 59 | 52.43 | — | — | — | — | — | — | — | |
| BERT-LSRBackbone=BERT-Base, Graph-based=LSR2020.10 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSR2021.04 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSR+BERT_baseBackbone=BERT-base2021.06 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSR-BERTpre-training=BERT2021.06 | 59 | 52.43 | 65.26 | 52.05 | — | — | — | — | — | |
| LSR-BERT_BaseBackbone=BERT-Base2020.12 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSR-BERTbasebackbone=BERT-base2022.03 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSRBackbone=BERT-base-cased2022.05 | 59 | 52.43 | — | — | — | — | — | — | — | |
| LSR-BERTBackbone=BERT-base2022.04 | 59 | 52.43 | 65.26 | 52.05 | — | — | — | — | — | |
| SSAN2022.05 | 58.95 | 56.68 | — | — | — | — | — | — | — | |
| CorefBERT-REPre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 58.88 | 56.73 | — | — | — | — | — | — | — | |
| BERT-REPre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 58.83 | 56.67 | — | — | — | — | — | — | — | |
| DUALRE model=BERTD2020.11 | 58.8 | — | — | — | — | — | — | — | — | |
| ERICA-BERT_BaseBackbone=BERT-Base2020.12 | 58.8 | 56.7 | — | — | — | — | — | — | — | |
| ERICA-RoBERTa_BaseBackbone=RoBERTa-Base2020.12 | 58.6 | 56.3 | — | — | — | — | — | — | — | |
| BERT-E_BASEBackbone=BERT-Base2020.10 | 58.52 | 56.51 | — | — | — | — | — | — | — | |
| CorefBERT+RSMANbackbone=CorefBERT, plugin=RSMAN2022.05 | 58.24 | 56.26 | — | — | — | — | — | — | — | |
| CorefBERT-REPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERT_BASEBackbone=BERT-Base, Pre-training=CorefBERT2020.10 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERTpre-training=BERT2021.06 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERT_BaseBackbone=BERT-Base2020.12 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERTbasebackbone=BERT-base2022.03 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERT2022.05 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| CorefBERTBackbone=BERT-base2022.04 | 57.51 | 55.32 | — | — | — | — | — | — | — | |
| DEMMT2021.04 | 57.38 | 55.5 | — | — | — | — | — | — | — | |
| GCGCN-BERT_BaseBackbone=BERT-Base2020.12 | 57.35 | 55.43 | — | — | — | — | — | — | — | |
| DRNType=Graph-based2021.06 | 56.49 | 54.61 | — | — | — | — | — | — | — | |
| CFERBackbone=GloVe2020.12 | 56.4 | 54.29 | — | — | — | — | — | — | — | |
| BERT_BASEBackbone=BERT-Base, Implementation=Our implementation2020.10 | 56.39 | 54.27 | — | — | — | — | — | — | — | |
| HIN-BERTEmbedding=BERT (768d)2020.03 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERTPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERT_BASEBackbone=BERT-Base, Architecture=Hierarchical2020.10 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERTpre-training=BERT2021.06 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERT_BaseBackbone=BERT-Base2020.12 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERTbasebackbone=BERT-base2022.03 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HIN-BERTBackbone=BERT-base2022.04 | 56.31 | 54.29 | — | — | — | — | — | — | — | |
| HeterGSAN-Rec*Type=Graph-based2021.06 | 56.22 | 54.27 | — | — | — | — | — | — | — | |
| HeterGSAN-ReconBackbone=GloVe2020.12 | 56.22 | 54.27 | — | — | — | — | — | — | — | |
| EP-RSR2026.04 | 56.17 | 53.74 | — | — | — | — | — | — | — | |
| GEDA2021.04 | 56.16 | 54.52 | — | — | — | — | — | — | — | |
| GEDA-BERT_BaseBackbone=BERT-Base2020.12 | 56.16 | 54.52 | — | — | — | — | — | — | — | |
| GEDA-BERTbasebackbone=BERT-base2022.03 | 56.16 | 54.52 | — | — | — | — | — | — | — | |
| GEDA-BERTBackbone=BERT-base2022.04 | 56.16 | 54.52 | — | — | — | — | — | — | — | |
| ROBERTA-REPre-trained=true, Backbone=ROBERTA, Model Scale=base2020.09 | 56.05 | 53.85 | — | — | 48.27 | 51.35 | — | — | — | |
| SIRE-GloVepre-training=none, configuration=full2021.06 | 55.91 | 54.1 | 62.94 | 48.97 | — | — | — | — | — |