Relation Extraction on DocRED v1 (test)
67.28F1Ours-KD-Rb-l
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ours-KD-Rb-lBackbone=Roberta-large, Distant Supervision=true, Knowledge Distillation=true2022.03 | 67.28 | 65.24 | |
| SSAN-NA-Rb-lBackbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true2022.03 | 65.92 | 63.78 | |
| Ours-NA-Rb-lBackbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true2022.03 | 65.71 | 63.63 | |
| ATLOP-NA-Rb-l*Backbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true, Reproduction=true2022.03 | 65.47 | 63.54 | |
| DocuNet-NA-Rb-l*Backbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true, Reproduction=true2022.03 | 65.44 | 63.29 | |
| SAIS-RoBERTalargeBackbone=RoBERTa-large2021.09 | 65.11 | 63.44 | |
| Eider-RoBERTalargeBackbone=RoBERTa-large2021.09 | 64.79 | 62.85 | |
| Ours-KD-B-bBackbone=Bert-base, Distant Supervision=true, Knowledge Distillation=true2022.03 | 64.76 | 62.56 | |
| DocuNet-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 64.55 | 62.39 | |
| DocuNet-RoBERTalargeBackbone=RoBERTa-large2021.09 | 64.55 | 62.39 | |
| Ours-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 64.28 | 62.57 | |
| Ours-NA-B-bBackbone=Bert-base, Distant Supervision=true, Naive Adaptation=true2022.03 | 64.12 | 61.77 | |
| DocuNet-Rb-l*Backbone=Roberta-large, Distant Supervision=false, Reproduction=true2022.03 | 63.73 | 61.79 | |
| ATLOP-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 63.4 | 61.39 | |
| ATLOP-RoBERTalargeBackbone=RoBERTa-large2021.09 | 63.4 | 61.39 | |
| SAIS-BERTbaseBackbone=BERT-base2021.09 | 62.77 | 60.96 | |
| GAIN-B-lBackbone=Bert-large, Distant Supervision=false2022.03 | 62.76 | 60.31 | |
| E2GRE-RoBERTalargeBackbone=RoBERTa-large2021.09 | 62.5 | 60.3 | |
| Eider-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 62.47 | 60.42 | |
| Ours-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 62.08 | 60.04 | |
| SSAN-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 62.08 | 60.25 | |
| SIRE-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 62.05 | 60.18 | |
| SIRE-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 62.05 | 60.18 | |
| DocuNet-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 61.86 | 59.93 | |
| DocuNet-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 61.86 | 59.93 | |
| SSAN-RoBERTalargeBackbone=RoBERTa-large2021.09 | 61.42 | 59.47 | |
| DRN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 61.37 | 59.15 | |
| ATLOP-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 61.3 | 59.31 | |
| ATLOP-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 61.3 | 59.31 | |
| GAIN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 61.24 | 59 | |
| Coref-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 60.25 | 57.9 | |
| CorefRoBERTalargeBackbone=RoBERTa-large2021.09 | 60.25 | 57.9 | |
| RoBERTalargeBackbone=RoBERTa-large2021.09 | 60.06 | 57.74 | |
| HeterGSAN+BERT+ReconstructionBackbone=BERT2020.12 | 59.45 | 57.12 | |
| HeterGSAN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 59.45 | 57.12 | |
| BERT+LSRBackbone=BERT2020.12 | 59.05 | 56.97 | |
| LSR-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 59.05 | 56.97 | |
| CorefBERTlargeBackbone=BERT-large2021.09 | 58.83 | 56.4 | |
| Two-stage-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 58.69 | 56.47 | |
| HeterGSAN+BERTBackbone=BERT2020.12 | 58.54 | 56.21 | |
| SSAN-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 58.41 | 56.06 | |
| BERTlargeBackbone=BERT-large2021.09 | 58.31 | 56.01 | |
| GLRE-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 57.4 | 55.4 | |
| CorefBERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 56.96 | 54.54 | |
| GEDA-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 55.74 | 53.71 | |
| HIN-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 55.6 | 53.7 | |
| HeterGSAN+ReconstructionBackbone=w/o BERT2020.12 | 55.23 | 53.27 | |
| LSRBackbone=w/o BERT2020.12 | 54.18 | 52.15 | |
| Two-Phase BERTBackbone=BERT2020.12 | 53.92 | — | |
| BERT-TSbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 53.92 | — | |
| HeterGSANBackbone=w/o BERT2020.12 | 53.52 | 52.07 | |
| BERTBackbone=BERT2020.12 | 53.2 | — | |
| BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 53.2 | — | |
| EoGBackbone=w/o BERT2020.12 | 51.82 | 49.48 | |
| EoGBackbone=BERT-base2021.09 | 51.82 | 49.48 | |
| GCNNBackbone=w/o BERT2020.12 | 51.62 | 49.59 | |
| GCNNBackbone=GCNN2021.09 | 51.62 | 49.59 | |
| AGGCNBackbone=w/o BERT2020.12 | 51.45 | 48.89 | |
| AGGCNBackbone=BERT-base2021.09 | 51.45 | 48.89 | |
| BiLSTMBackbone=w/o BERT2020.12 | 51.06 | 48.78 | |
| BiLSTMBackbone=BiLSTM2021.09 | 51.06 | 48.78 | |
| ContexAwareBackbone=w/o BERT2020.12 | 50.07 | 48.4 | |
| GATBackbone=w/o BERT2020.12 | 49.51 | 47.36 | |
| GATBackbone=GAT2021.09 | 49.51 | 47.36 | |
| CNNBackbone=w/o BERT2020.12 | 42.26 | 40.33 | |
| CNNBackbone=CNN2021.09 | 42.26 | 40.33 |