Document-level Relation Extraction on DocRED (test)
64.03F1 ScoreKD-DocRE-RoBERTa_large
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| KD-DocRE-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 64.03 | 62.13 | — | — | — | |
| NCRL-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 63.93 | 61.67 | — | — | — | |
| DocuNet-RoBERTa_largeBackbone=RoBERTa-large, EVRT=false2024.06 | 63.77 | 61.59 | — | — | — | |
| DRE-MIR-BERTBackbone=BERT-base2022.04 | 62.85 | 60.91 | — | — | — | |
| GAIN-BERTlargePre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 62.76 | 60.31 | — | — | — | |
| CFER-RoBERTa_LargeBackbone=RoBERTa-Large2020.12 | 62.76 | 60.7 | — | — | — | |
| Dense-CCNet-BERTbasebackbone=BERT-base2022.03 | 62.55 | 60.46 | — | — | — | |
| DocuNet-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 62.46 | 60.48 | — | — | — | |
| NCRL-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 62.21 | 60.28 | — | — | — | |
| KD-DocRE-RoBERTa_large + EVRTBackbone=RoBERTa-large, EVRT=true2024.06 | 62.2 | 60.49 | — | — | — | |
| AFLKDBackbone=BERT-base-cased2022.05 | 62.08 | 60.04 | — | — | — | |
| SIRE-BERTpre-training=BERT2021.06 | 62.05 | 60.18 | — | — | — | |
| SIRE-BERTBackbone=BERT-base2022.04 | 62.05 | 60.18 | — | — | — | |
| DocuNet-BERTbasebackbone=BERT-base2022.03 | 61.86 | 59.93 | — | — | — | |
| DocuNetBackbone=BERT-base-cased2022.05 | 61.86 | 59.93 | — | — | — | |
| DocuNet-BERTBackbone=BERT-base2022.04 | 61.86 | 59.93 | — | — | — | |
| HCRE2026.04 | 61.57 | 60.18 | — | — | — | |
| NCRL-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 61.51 | 59.34 | — | — | — | |
| DRN+BERT_baseBackbone=BERT-base2021.06 | 61.37 | 59.15 | — | — | — | |
| DRNBackbone=BERT-base-cased2022.05 | 61.37 | 59.15 | — | — | — | |
| ERACLBackbone=BERT-base-cased2022.05 | 61.36 | 59.08 | — | — | — | |
| ATLOP-BERT_baseBackbone=BERT-base2021.06 | 61.3 | 59.31 | — | — | — | |
| ATLOP-BERTbasebackbone=BERT-base2022.03 | 61.3 | 59.31 | — | — | — | |
| ATLOPBackbone=BERT-base-cased2022.05 | 61.3 | 59.31 | — | — | — | |
| ATLOP-BERTBackbone=BERT-base2022.04 | 61.3 | 59.31 | — | — | — | |
| CFER-BERT_BaseBackbone=BERT-Base2020.12 | 61.28 | 59.16 | — | — | — | |
| GAIN-BERTbasePre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 61.24 | 59 | — | — | — | |
| GAIN+BERT_baseBackbone=BERT-base2021.06 | 61.24 | 59 | — | — | — | |
| GAIN-BERTpre-training=BERT2021.06 | 61.24 | 59 | — | — | — | |
| GAIN-BERT_BaseBackbone=BERT-Base2020.12 | 61.24 | 59 | — | — | — | |
| GAIN-BERTbasebackbone=BERT-base2022.03 | 61.24 | 59 | — | — | — | |
| GAINBackbone=BERT-base-cased2022.05 | 61.24 | 59 | — | — | — | |
| GAIN-BERTBackbone=BERT-base2022.04 | 61.24 | 59 | — | — | — | |
| KD-DocRE-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 61.02 | 59.16 | — | — | — | |
| ERABackbone=BERT-base-cased2022.05 | 60.97 | 58.71 | — | — | — | |
| DocuNet-BERT_baseBackbone=BERT-base, EVRT=false2024.06 | 60.83 | 58.89 | — | — | — | |
| Vanilla2026.04 | 60.77 | 59.63 | — | — | — | |
| NCRL-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 60.51 | 58.84 | — | — | — | |
| KD-DocRE-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 60.21 | 58.69 | — | — | — | |
| MIUKrepresentation=three-view2021.04 | 59.99 | 58.05 | — | — | — | |
| MIUKBackbone=BERT-Base2020.12 | 59.99 | 58.05 | — | — | — | |
| CorefROBERTa-REPre-trained=true, Backbone=ROBERTa, Model Scale=large2020.09 | 59.91 | 57.68 | — | — | — | |
| CorefRoBERTa_LargeBackbone=RoBERTa-Large2020.12 | 59.91 | 57.68 | — | — | — | |
| DocuNet-BERT_base + EVRTBackbone=BERT-base, EVRT=true2024.06 | 59.71 | 58.17 | — | — | — | |
| ROBERTa-REPre-trained=true, Backbone=ROBERTa, Model Scale=large2020.09 | 59.62 | 57.51 | — | — | — | |
| HeterGSAN-Rec+BERT_baseBackbone=BERT-base2021.06 | 59.45 | 57.12 | — | — | — | |
| HeterGSAN-Recon-BERT_BaseBackbone=BERT-Base2020.12 | 59.45 | 57.12 | — | — | — | |
| HeterGSAN-BERTbasebackbone=BERT-base2022.03 | 59.45 | 57.12 | — | — | — | |
| HeterGSAN-BERTBackbone=BERT-base2022.04 | 59.45 | 57.12 | — | — | — | |
| SSAN+RSMANbackbone=SSAN, plugin=RSMAN2022.05 | 59.29 | 57.02 | — | — | — | |
| LSRbackbone=BERT2020.05 | 59.05 | 56.97 | — | — | — | |
| LSR-BERTPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 59.05 | 56.97 | — | — | — | |
| LSR2021.04 | 59.05 | 56.97 | — | — | — | |
| LSR+BERT_baseBackbone=BERT-base2021.06 | 59.05 | 56.97 | — | — | — | |
| LSR-BERTpre-training=BERT2021.06 | 59.05 | 56.97 | — | — | — | |
| LSR-BERT_BaseBackbone=BERT-Base2020.12 | 59.05 | 56.97 | — | — | — | |
| LSR-BERTbasebackbone=BERT-base2022.03 | 59.05 | 56.97 | — | — | — | |
| LSRBackbone=BERT-base-cased2022.05 | 59.05 | 56.96 | — | — | — | |
| LSR-BERTBackbone=BERT-base2022.04 | 59.05 | 56.97 | — | — | — | |
| ERICA-RoBERTa_BaseBackbone=RoBERTa-Base2020.12 | 59 | 56.6 | — | — | — | |
| CorefBERT-REPre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 58.7 | 56.48 | — | — | — | |
| BERT-REPre-trained=true, Backbone=BERT, Model Scale=large2020.09 | 58.69 | 56.47 | — | — | — | |
| SSANBackbone=BERT-base-cased2022.05 | 58.41 | 56.06 | — | — | — | |
| SSAN2022.05 | 58.41 | 56.06 | — | — | — | |
| ERICA-BERT_BaseBackbone=BERT-Base2020.12 | 58.2 | 55.9 | — | — | — | |
| DUALRE model=BERTD2020.11 | 57.74 | — | — | — | — | |
| CorefBERT+RSMANbackbone=CorefBERT, plugin=RSMAN2022.05 | 57.53 | 55.3 | — | — | — | |
| GLRE-BERTpre-training=BERT2021.06 | 57.4 | 55.4 | — | — | — | |
| GLRE-BERTbasebackbone=BERT-base2022.03 | 57.4 | — | — | — | — | |
| GLREBackbone=BERT-base-cased2022.05 | 57.4 | 55.4 | — | — | — | |
| GLRE-BERTBackbone=BERT-base2022.04 | 57.4 | 55.4 | — | — | — | |
| DEMMT2021.04 | 57.13 | 54.93 | — | — | — | |
| CorefBERT-REPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 56.96 | 54.54 | — | — | — | |
| CorefBERTpre-training=BERT2021.06 | 56.96 | 54.54 | — | — | — | |
| CorefBERT_BaseBackbone=BERT-Base2020.12 | 56.96 | 54.54 | — | — | — | |
| CorefBERTbasebackbone=BERT-base2022.03 | 56.96 | 54.54 | — | — | — | |
| CorefBERT2022.05 | 56.96 | 54.54 | — | — | — | |
| CorefBERTBackbone=BERT-base2022.04 | 56.96 | 54.54 | — | — | — | |
| GCGCN-BERT_BaseBackbone=BERT-Base2020.12 | 56.67 | 54.53 | — | — | — | |
| EP-RSR2026.04 | 56.47 | 53.22 | — | — | — | |
| DRNType=Graph-based2021.06 | 56.33 | 54.35 | — | — | — | |
| SIRE-GloVepre-training=none, configuration=full2021.06 | 55.96 | 54.04 | — | — | — | |
| ROBERTA-REPre-trained=true, Backbone=ROBERTA, Model Scale=base2020.09 | 55.77 | 53.52 | — | — | — | |
| CFERBackbone=GloVe2020.12 | 55.75 | 53.43 | — | — | — | |
| GEDA2021.04 | 55.74 | 53.71 | — | — | — | |
| GEDA-BERT_BaseBackbone=BERT-Base2020.12 | 55.74 | 53.71 | — | — | — | |
| GEDA-BERTbasebackbone=BERT-base2022.03 | 55.74 | 53.71 | — | — | — | |
| GEDA-BERTBackbone=BERT-base2022.04 | 55.74 | 53.71 | — | — | — | |
| HIN-BERTPre-trained=true, Backbone=BERT, Model Scale=base2020.09 | 55.6 | 53.7 | — | — | — | |
| HIN-BERTpre-training=BERT2021.06 | 55.6 | 53.7 | — | — | — | |
| HIN-BERT_BaseBackbone=BERT-Base2020.12 | 55.6 | 53.7 | — | — | — | |
| HIN-BERTbasebackbone=BERT-base2022.03 | 55.6 | 53.7 | — | — | — | |
| HIN-BERTBackbone=BERT-base2022.04 | 55.6 | 53.7 | — | — | — | |
| SIRE-GloVe (-LR Module)pre-training=none, ablation=logical reasoning module removed2021.06 | 55.55 | 53.75 | — | — | — | |
| HeterGSAN-Rec*Type=Graph-based2021.06 | 55.23 | 53.27 | — | — | — | |
| HeterGSAN-ReconBackbone=GloVe2020.12 | 55.23 | 53.27 | — | — | — | |
| GAIN-GloVePre-trained=false, Backbone=GloVe2020.09 | 55.08 | 52.66 | — | — | — | |
| GAIN*Type=Graph-based2021.06 | 55.08 | 52.66 | — | — | — | |
| GAIN-GloVepre-training=none2021.06 | 55.08 | 52.66 | — | — | — | |
| GAINBackbone=GloVe2020.12 | 55.08 | 52.66 | — | — | — |