Relation Extraction on DocRED (dev)
65.69F1 ScoreSSAN_Biaffine
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SSAN_BiaffineBackbone=RoBERTa-Large, Transformation=Biaffine, Adaptation=true2021.02 | 65.69 | 63.76 | — | — | |
| SAISBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 65.17 | 62.23 | — | — | |
| EIDERBackbone=RoBERTa-large2021.06 | 64.27 | 62.34 | 70.36 | 56.53 | |
| EiderBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 64.27 | 62.34 | — | — | |
| DocuNetBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 64.12 | 62.23 | — | — | |
| EIDERBackbone=RoBERTa-large, Mode=Rule-based2021.06 | 63.91 | 61.73 | 69.99 | 56.27 | |
| ATLOPBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 63.18 | 61.32 | — | — | |
| ATLOP-RoBERTaBackbone=RoBERTa-large2021.06 | 63.15 | 61.3 | 69.61 | 55.01 | |
| GAIN-BERTBackbone=BERT-large2021.06 | 63.09 | 60.87 | — | — | |
| CorefDREEmbeddings=BERT_base, Pre-trained=true2022.02 | 63.06 | 60.85 | — | — | |
| SAISBackbone=BERT-base, Architecture=Transformer-based2021.09 | 62.96 | 59.98 | — | — | |
| E2GRE-RoBERTaBackbone=RoBERTa-large2021.06 | 62.91 | 59.55 | — | — | |
| EIDERBackbone=BERT-base2021.06 | 62.48 | 60.51 | 68.47 | 55.21 | |
| EiderBackbone=BERT-base, Architecture=Transformer-based2021.09 | 62.48 | 60.51 | — | — | |
| EIDERBackbone=BERT-base, Mode=Rule-based2021.06 | 62.34 | 60.36 | 68.4 | 54.79 | |
| SSAN_BiaffineBackbone=RoBERTa-Large, Transformation=Biaffine2021.02 | 62.08 | 60.25 | — | — | |
| SSANBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 62.08 | 60.25 | — | — | |
| DocuNet-BERT_basePre-trained=true2022.02 | 61.83 | 59.86 | — | — | |
| DocuNetBackbone=BERT-base, Architecture=Transformer-based2021.09 | 61.83 | 59.86 | — | — | |
| SIREBackbone=BERT-base, Architecture=Graph-based2021.09 | 61.6 | 59.82 | — | — | |
| SSAN_DecompBackbone=RoBERTa-Large, Transformation=Decomposed Linear2021.02 | 61.5 | 59.54 | — | — | |
| DRNBackbone=BERT-base, Architecture=Graph-based2021.09 | 61.39 | 59.33 | — | — | |
| GAINEmbeddings=BERT_base, Pre-trained=true2022.02 | 61.22 | 59.15 | — | — | |
| GAIN-BERTBackbone=BERT-base2021.06 | 61.22 | 59.14 | 67.1 | 53.9 | |
| GAINBackbone=BERT-base, Architecture=Graph-based2021.09 | 61.22 | 59.14 | — | — | |
| SSAN_BiaffineBackbone=BERT-Large, Transformation=Biaffine2021.02 | 61.09 | 59.12 | — | — | |
| ATLOPBackbone=BERT-base, Architecture=Transformer-based2021.09 | 61.09 | 59.22 | — | — | |
| ATLOP-BERTBackbone=BERT-base2021.06 | 61.01 | 59.11 | 67.26 | 53.2 | |
| SSAN_BiaffineBackbone=RoBERTa-Base, Transformation=Biaffine2021.02 | 60.89 | 58.83 | — | — | |
| ROBERTa Large BaselineBackbone=RoBERTa-Large2021.02 | 60.58 | 58.45 | — | — | |
| SSAN_DecompBackbone=BERT-Large, Transformation=Decomposed Linear2021.02 | 60.36 | 58.42 | — | — | |
| SSAN_DecompBackbone=RoBERTa-Base, Transformation=Decomposed Linear2021.02 | 60.22 | 58.29 | — | — | |
| BERT Large BaselineBackbone=BERT-Large2021.02 | 60.18 | 58.11 | — | — | |
| Reconstruct-BERTBackbone=BERT-base2021.06 | 60.18 | 58.13 | — | — | |
| HeterGSANBackbone=BERT-base, Architecture=Graph-based2021.09 | 60.18 | 58.13 | — | — | |
| CorefROBERTaBackbone=RoBERTa2021.02 | 59.93 | 57.84 | — | — | |
| ROBERTa Base BaselineBackbone=RoBERTa-Base2021.02 | 59.52 | 57.47 | — | — | |
| CorefRoBERTabackbone=LARGE2020.04 | 59.43 | 57.35 | — | — | |
| CorefRoBERTaBackbone=RoBERTa-large2021.06 | 59.43 | 57.35 | — | — | |
| RoBERTabackbone=LARGE2020.04 | 59.4 | 57.19 | — | — | |
| RoBERTaBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 59.4 | 57.19 | — | — | |
| RoBERTaBackbone=RoBERTa-large2021.06 | 59.22 | 57.14 | — | — | |
| SSAN_BiaffineBackbone=BERT-Base, Transformation=Biaffine2021.02 | 59.19 | 57.03 | — | — | |
| SSANBackbone=BERT-base, Architecture=Transformer-based2021.09 | 59.19 | 57.03 | — | — | |
| CorefBERTbackbone=LARGE2020.04 | 59.01 | 56.82 | — | — | |
| BERT+LSRBackbone=BERT2021.02 | 59 | 52.43 | — | — | |
| LSR-BERTBackbone=BERT-base2021.06 | 59 | 52.43 | 65.26 | 52.05 | |
| SSAN_DecompBackbone=BERT-Base, Transformation=Decomposed Linear2021.02 | 58.95 | 56.68 | — | — | |
| CorefBERT LargeBackbone=BERT-Large2021.02 | 58.88 | 56.73 | — | — | |
| E2GRE-BERTBackbone=BERT-base2021.06 | 58.72 | 55.22 | — | — | |
| E2GREBackbone=BERT-base, Architecture=Transformer-based2021.09 | 58.72 | 55.22 | — | — | |
| BERTbackbone=LARGE2020.04 | 58.7 | 56.51 | — | — | |
| BERT Base BaselineBackbone=BERT-Base2021.02 | 58.6 | 56.29 | — | — | |
| CorefBERTbackbone=BASE2020.04 | 57.51 | 55.32 | — | — | |
| CorefBERT BaseBackbone=BERT-Base2021.02 | 57.51 | 55.32 | — | — | |
| CorefBERT_basePre-trained=true2022.02 | 57.51 | 55.32 | — | — | |
| CorefBERTBackbone=BERT-base2021.06 | 57.51 | 55.32 | — | — | |
| GLREbackbone=BERT-Base-uncased2020.09 | 57.4 | 55.4 | — | — | |
| CorefDREEmbeddings=GloVe, Pre-trained=false2022.02 | 57.33 | 55.01 | — | — | |
| BERTbackbone=BASE2020.04 | 56.77 | 54.63 | — | — | |
| Paths+BiLSTMbackbone=BiLSTM, input=Path-based2021.06 | 56.54 | — | 62.73 | 49.11 | |
| HinBERTbackbone=BASE2020.04 | 56.31 | 54.29 | — | — | |
| HINBERT2021.02 | 56.31 | 54.29 | — | — | |
| HIN-BERTBackbone=BERT-base2021.06 | 56.31 | 54.29 | — | — | |
| Tang et al.backbone=BERT2020.09 | 55.6 | 53.7 | — | — | |
| Wang et al.backbone=BERT-Base-uncased2020.09 | 55.4 | 53.1 | — | — | |
| GAIN-Gloveembeddings=Glove2021.06 | 55.29 | — | 61.67 | 48.77 | |
| GAINEmbeddings=GloVe, Pre-trained=false2022.02 | 55.29 | 53.03 | — | — | |
| GloVe+LSRBackbone=GloVe2021.02 | 55.17 | 48.82 | — | — | |
| LSR-Gloveembeddings=Glove2021.06 | 55.17 | — | 60.83 | 48.35 | |
| BERT-TSbackbone=BASE2020.04 | 54.42 | — | — | — | |
| BERT Two-Phase2021.02 | 54.42 | — | — | — | |
| BERT-Two-StepBackbone=BERT-base2021.06 | 54.42 | — | 61.8 | 47.28 | |
| BERT_basePre-trained=true2022.02 | 54.16 | — | — | — | |
| BERTBackbone=BERT-base2021.06 | 54.16 | — | 61.61 | 47.15 | |
| BERTBackbone=BERT-base, Architecture=Transformer-based2021.09 | 54.16 | — | — | — | |
| HIN-Gloveembeddings=Glove2021.06 | 52.95 | — | 60.83 | 48.35 | |
| AGGCN2021.06 | 52.47 | — | 58.76 | 45.45 | |
| EoG*2021.02 | 52.15 | 45.94 | — | — | |
| EoG2021.06 | 52.15 | — | 58.8 | 44.6 | |
| Zhang et al.word embeddings=GloVe2020.09 | 52.1 | 49.9 | — | — | |
| GCNN2021.06 | 51.52 | — | 57.78 | 44.11 | |
| GAT2021.06 | 51.44 | — | 58.14 | 43.94 | |
| Yao et al. (BiLSTM)word embeddings=GloVe, architecture=BiLSTM2020.09 | 51.1 | 48.8 | — | — | |
| ContextAware2020.04 | 51.09 | 48.94 | — | — | |
| ContexAware2021.02 | 51.09 | 48.94 | — | — | |
| ConText-AwarePre-trained=false2022.02 | 51.09 | 48.94 | — | — | |
| BiLSTM2020.04 | 50.94 | 48.87 | — | — | |
| BILSTM2021.06 | 50.94 | — | 57.05 | 43.49 | |
| BiLSTMPre-trained=false2022.02 | 50.94 | 48.87 | — | — | |
| Christopoulou et al.word embeddings=GloVe2020.09 | 50.9 | 49.1 | — | — | |
| Yao et al. (Context-aware)word embeddings=GloVe, architecture=Context-aware2020.09 | 50.7 | 48.4 | — | — | |
| LSTM2020.04 | 50.68 | 48.44 | — | — | |
| Yao et al. (LSTM)word embeddings=GloVe, architecture=LSTM2020.09 | 50.1 | 47.7 | — | — | |
| CNN2020.04 | 43.45 | 41.58 | — | — | |
| CNN2021.06 | 43.45 | — | 51.87 | 37.58 | |
| CNNPre-trained=false2022.02 | 43.45 | 41.58 | — | — | |
| Yao et al. (CNN)word embeddings=GloVe, architecture=CNN2020.09 | 42.3 | 40.3 | — | — |