Relation Extraction on DocRED v1 (dev)
67.12F1 ScoreOurs-KD-Rb-l
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ours-KD-Rb-lBackbone=Roberta-large, Distant Supervision=true, Knowledge Distillation=true2022.03 | 67.12 | 65.27 | |
| SSAN-NA-Rb-lBackbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true2022.03 | 65.69 | 63.76 | |
| Ours-NA-Rb-lBackbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true2022.03 | 65.64 | 63.38 | |
| ATLOP-NA-Rb-l*Backbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true, Reproduction=true2022.03 | 65.33 | 63.41 | |
| DocuNet-NA-Rb-l*Backbone=Roberta-large, Distant Supervision=true, Naive Adaptation=true, Reproduction=true2022.03 | 65.21 | 63.26 | |
| SAIS-RoBERTalargeBackbone=RoBERTa-large2021.09 | 65.17 | 62.23 | |
| Ours-KD-B-bBackbone=Bert-base, Distant Supervision=true, Knowledge Distillation=true2022.03 | 64.81 | 62.62 | |
| Eider-RoBERTalargeBackbone=RoBERTa-large2021.09 | 64.27 | 62.34 | |
| Ours-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 64.19 | 62.16 | |
| Ours-NA-B-bBackbone=Bert-base, Distant Supervision=true, Naive Adaptation=true2022.03 | 64.17 | 62.18 | |
| DocuNet-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 64.12 | 62.23 | |
| DocuNet-RoBERTalargeBackbone=RoBERTa-large2021.09 | 64.12 | 62.23 | |
| DocuNet-Rb-l*Backbone=Roberta-large, Distant Supervision=false, Reproduction=true2022.03 | 63.58 | 61.56 | |
| ATLOP-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 63.18 | 61.32 | |
| ATLOP-RoBERTalargeBackbone=RoBERTa-large2021.09 | 63.18 | 61.32 | |
| GAIN-B-lBackbone=Bert-large, Distant Supervision=false2022.03 | 63.09 | 60.87 | |
| SAIS-BERTbaseBackbone=BERT-base2021.09 | 62.96 | 59.98 | |
| Eider-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 62.48 | 60.51 | |
| SSAN-RoBERTalargeBackbone=RoBERTa-large2021.09 | 62.08 | 60.25 | |
| Ours-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 62.03 | 60.08 | |
| DocuNet-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 61.83 | 59.86 | |
| DocuNet-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 61.83 | 59.86 | |
| SIRE-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 61.6 | 59.82 | |
| SIRE-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 61.6 | 59.82 | |
| SSAN-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 61.42 | 59.4 | |
| DRN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 61.39 | 59.33 | |
| GAIN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 61.22 | 59.14 | |
| ATLOP-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 61.09 | 59.22 | |
| ATLOP-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 61.09 | 59.22 | |
| HeterGSAN+BERT+ReconstructionBackbone=BERT2020.12 | 60.18 | 58.13 | |
| HeterGSAN-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 60.18 | 58.13 | |
| Coref-Rb-lBackbone=Roberta-large, Distant Supervision=false2022.03 | 59.43 | 57.35 | |
| CorefRoBERTalargeBackbone=RoBERTa-large2021.09 | 59.43 | 57.35 | |
| RoBERTalargeBackbone=RoBERTa-large2021.09 | 59.4 | 57.19 | |
| SSAN-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 59.19 | 57.03 | |
| HeterGSAN+BERTBackbone=BERT2020.12 | 59.13 | 57 | |
| CorefBERTlargeBackbone=BERT-large2021.09 | 59.01 | 56.82 | |
| BERT+LSRBackbone=BERT2020.12 | 59 | 52.43 | |
| LSR-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 59 | 52.43 | |
| Two-stage-B-bBackbone=Bert-base, Distant Supervision=false2022.03 | 58.83 | 56.67 | |
| E2GRE-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 58.72 | 55.22 | |
| BERTlargeBackbone=BERT-large2021.09 | 58.7 | 56.51 | |
| CorefBERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 57.51 | 55.32 | |
| HIN-BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 56.31 | 54.29 | |
| HeterGSAN+ReconstructionBackbone=w/o BERT2020.12 | 56.22 | 54.27 | |
| GEDA-BERTbaseBackbone=BERT-base, Category=Graph-based2021.09 | 56.16 | 54.52 | |
| LSRBackbone=w/o BERT2020.12 | 55.17 | 48.82 | |
| Two-Phase BERTBackbone=BERT2020.12 | 54.42 | — | |
| BERT-TSbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 54.42 | — | |
| HeterGSANBackbone=w/o BERT2020.12 | 54.4 | 52.17 | |
| BERTBackbone=BERT2020.12 | 54.16 | — | |
| BERTbaseBackbone=BERT-base, Category=Transformer-based2021.09 | 54.16 | — | |
| AGGCNBackbone=w/o BERT2020.12 | 52.47 | 46.29 | |
| AGGCNBackbone=BERT-base2021.09 | 52.47 | 46.29 | |
| EoGBackbone=w/o BERT2020.12 | 52.15 | 45.94 | |
| EoGBackbone=BERT-base2021.09 | 52.15 | 45.94 | |
| GCNNBackbone=w/o BERT2020.12 | 51.52 | 46.22 | |
| GCNNBackbone=GCNN2021.09 | 51.52 | 46.22 | |
| GATBackbone=w/o BERT2020.12 | 51.44 | 45.17 | |
| GATBackbone=GAT2021.09 | 51.44 | 45.17 | |
| ContexAwareBackbone=w/o BERT2020.12 | 51.09 | 48.94 | |
| BiLSTMBackbone=w/o BERT2020.12 | 50.94 | 48.87 | |
| BiLSTMBackbone=BiLSTM2021.09 | 50.94 | 48.87 | |
| CNNBackbone=w/o BERT2020.12 | 43.45 | 41.58 | |
| CNNBackbone=CNN2021.09 | 43.45 | 41.58 |