Relation Extraction on DocRED (test)
65.92F1 ScoreSSAN_Biaffine
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SSAN_BiaffineBackbone=RoBERTa-Large, Transformation=Biaffine, Adaptation=true2021.02 | 65.92 | 63.78 | — | — | |
| SAISBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 65.11 | 63.44 | — | — | |
| EIDERBackbone=RoBERTa-large2021.06 | 64.79 | 62.85 | — | — | |
| EiderBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 64.79 | 62.85 | — | — | |
| DocuNetBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 64.55 | 62.39 | — | — | |
| EIDERBackbone=RoBERTa-large, Mode=Rule-based2021.06 | 64.12 | 61.93 | — | — | |
| ROBERTa-ATLOP_LARGEBackbone=ROBERTa-Large2020.10 | 63.4 | 61.39 | — | — | |
| ATLOP-RoBERTaBackbone=RoBERTa-large2021.06 | 63.4 | 61.39 | — | — | |
| ATLOPBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 63.4 | 61.39 | — | — | |
| SAISBackbone=BERT-base, Architecture=Transformer-based2021.09 | 62.77 | 60.96 | — | — | |
| GAIN-BERTBackbone=BERT-large2021.06 | 62.76 | 60.31 | — | — | |
| E2GRE-RoBERTaBackbone=RoBERTa-large2021.06 | 62.51 | 60.29 | — | — | |
| E2GREBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 62.5 | 60.3 | — | — | |
| EIDERBackbone=BERT-base2021.06 | 62.47 | 60.42 | — | — | |
| EiderBackbone=BERT-base, Architecture=Transformer-based2021.09 | 62.47 | 60.42 | — | — | |
| EIDERBackbone=BERT-base, Mode=Rule-based2021.06 | 62.21 | 60.23 | — | — | |
| SIREBackbone=BERT-base, Architecture=Graph-based2021.09 | 62.05 | 60.18 | — | — | |
| DocuNet-BERT_basePre-trained=true2022.02 | 61.86 | 59.93 | — | — | |
| DocuNetBackbone=BERT-base, Architecture=Transformer-based2021.09 | 61.86 | 59.93 | — | — | |
| SSAN_BiaffineBackbone=RoBERTa-Large, Transformation=Biaffine2021.02 | 61.42 | 59.47 | — | — | |
| SSANBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 61.42 | 59.47 | — | — | |
| ATLOP + KIREBackbone=BERT-base, Enhancement=KIRE2022.07 | 61.39 | 59.35 | — | — | |
| DRNBackbone=BERT-base, Architecture=Graph-based2021.09 | 61.37 | 59.15 | — | — | |
| BERT-ATLOP_BASEBackbone=BERT-Base2020.10 | 61.3 | 59.31 | — | — | |
| ATLOP-BERTBackbone=BERT-base2021.06 | 61.3 | 59.31 | — | — | |
| ATLOPBackbone=BERT-base, Architecture=Transformer-based2021.09 | 61.3 | 59.31 | — | — | |
| SSAN_DecompBackbone=RoBERTa-Large, Transformation=Decomposed Linear2021.02 | 61.24 | 59.11 | — | — | |
| GAIN-BERTBackbone=BERT-base2021.06 | 61.24 | 59 | — | — | |
| GAINBackbone=BERT-base, Architecture=Graph-based2021.09 | 61.24 | 59 | — | — | |
| CorefDREEmbeddings=BERT_base, Pre-trained=true2022.02 | 60.82 | 60.78 | — | — | |
| SSAN_BiaffineBackbone=BERT-Large, Transformation=Biaffine2021.02 | 60.81 | 58.76 | — | — | |
| ROBERTa Large BaselineBackbone=RoBERTa-Large2021.02 | 60.54 | 58.43 | — | — | |
| ATLOPBackbone=BERT-base2022.07 | 60.44 | 58.32 | — | — | |
| JEREX (MRC)Transformer-type model for document encoding=true, classification_type=multi-instance2021.02 | 60.4 | 58.44 | — | — | |
| CorefRoBERTabackbone=LARGE2020.04 | 60.25 | 57.9 | — | — | |
| CorefROBERTa_LARGEBackbone=ROBERTa-Large, Pre-training=CorefROBERTa2020.10 | 60.25 | 57.9 | — | — | |
| CorefRoTransformer-type model for document encoding=true2021.02 | 60.25 | 57.9 | — | — | |
| CorefRoBERTaBackbone=RoBERTa-large2021.06 | 60.25 | 57.9 | — | — | |
| RoBERTabackbone=LARGE2020.04 | 60.06 | 57.74 | — | — | |
| RoBERTaBackbone=RoBERTa-large, Architecture=Transformer-based2021.09 | 60.06 | 57.74 | — | — | |
| BERT Large BaselineBackbone=BERT-Large2021.02 | 60.03 | 57.91 | — | — | |
| SSAN_DecompBackbone=BERT-Large, Transformation=Decomposed Linear2021.02 | 60.01 | 57.97 | — | — | |
| SSAN_BiaffineBackbone=RoBERTa-Base, Transformation=Biaffine2021.02 | 59.94 | 57.71 | — | — | |
| CorefROBERTaBackbone=RoBERTa2021.02 | 59.91 | 57.68 | — | — | |
| SSAN_DecompBackbone=RoBERTa-Base, Transformation=Decomposed Linear2021.02 | 59.75 | 57.72 | — | — | |
| RoBERTaBackbone=RoBERTa-large2021.06 | 59.62 | 57.51 | — | — | |
| ROBERTa Base BaselineBackbone=RoBERTa-Base2021.02 | 59.48 | 57.27 | — | — | |
| Reconstruct-BERTBackbone=BERT-base2021.06 | 59.45 | 57.12 | — | — | |
| HeterGSANBackbone=BERT-base, Architecture=Graph-based2021.09 | 59.45 | 57.12 | — | — | |
| BERT-LSRBackbone=BERT-Base, Graph-based=LSR2020.10 | 59.05 | 56.97 | — | — | |
| BERT+LSRBackbone=BERT2021.02 | 59.05 | 56.97 | — | — | |
| LSRTransformer-type model for document encoding=true2021.02 | 59.05 | 56.97 | — | — | |
| GAINEmbeddings=BERT_base, Pre-trained=true2022.02 | 59.05 | 59 | — | — | |
| LSR-BERTBackbone=BERT-base2021.06 | 59.05 | 56.97 | — | — | |
| GLREbackbone=BERT-Base-uncased2020.09 | 58.9 | 56.7 | — | — | |
| CorefBERTbackbone=LARGE2020.04 | 58.83 | 56.4 | — | — | |
| CorefBERT LargeBackbone=BERT-Large2021.02 | 58.7 | 56.48 | — | — | |
| SSAN + KIREBackbone=BERT-base, Enhancement=KIRE2022.07 | 58.65 | 56.31 | — | — | |
| GLRE + KIREBackbone=BERT-base, Enhancement=KIRE2022.07 | 58.49 | 56.54 | — | — | |
| SSAN_DecompBackbone=BERT-Base, Transformation=Decomposed Linear2021.02 | 58.41 | 56.06 | — | — | |
| SSANBackbone=BERT-base, Architecture=Transformer-based2021.09 | 58.41 | 56.06 | — | — | |
| SSANBackbone=BERT-base2022.07 | 58.41 | 56.06 | — | — | |
| BERTbackbone=LARGE2020.04 | 58.31 | 56.01 | — | — | |
| SSAN_BiaffineBackbone=BERT-Base, Transformation=Biaffine2021.02 | 58.16 | 55.84 | — | — | |
| BERT Base BaselineBackbone=BERT-Base2021.02 | 57.54 | 55.08 | — | — | |
| GLRE-BERTBackbone=BERT-base2021.06 | 57.4 | 55.4 | — | — | |
| GLREBackbone=BERT-base2022.07 | 57.4 | 55.4 | — | — | |
| CorefBERTbackbone=BASE2020.04 | 56.96 | 54.54 | — | — | |
| CorefBERT_BASEBackbone=BERT-Base, Pre-training=CorefBERT2020.10 | 56.96 | 54.54 | — | — | |
| CorefBERT BaseBackbone=BERT-Base2021.02 | 56.96 | 54.54 | — | — | |
| CorefBERT_basePre-trained=true2022.02 | 56.96 | 54.54 | — | — | |
| CorefBERTBackbone=BERT-base2021.06 | 56.96 | 54.54 | — | — | |
| CorefDREEmbeddings=GloVe, Pre-trained=false2022.02 | 56.74 | 54.37 | — | — | |
| Wang et al.backbone=BERT-Base-uncased2020.09 | 56.5 | 54.5 | — | — | |
| BERTbackbone=BASE2020.04 | 56.27 | 53.93 | — | — | |
| Paths+BiLSTMbackbone=BiLSTM, input=Path-based2021.06 | 56.23 | — | — | — | |
| JEREX (GRC)Transformer-type model for document encoding=true, classification_type=global2021.02 | 55.91 | 53.76 | — | — | |
| HinBERTbackbone=BASE2020.04 | 55.6 | 53.7 | — | — | |
| HIN-BERT_BASEBackbone=BERT-Base, Architecture=Hierarchical2020.10 | 55.6 | 53.7 | — | — | |
| HINBERT2021.02 | 55.6 | 53.7 | — | — | |
| HINTransformer-type model for document encoding=true2021.02 | 55.6 | 53.7 | — | — | |
| HIN-BERTBackbone=BERT-base2021.06 | 55.6 | 53.7 | — | — | |
| GAIN-Gloveembeddings=Glove2021.06 | 55.08 | — | — | — | |
| GAINEmbeddings=GloVe, Pre-trained=false2022.02 | 55.08 | 52.66 | — | — | |
| Zhang et al.word embeddings=GloVe2020.09 | 54.6 | 52.5 | — | — | |
| BILSTM-LSRBackbone=BiLSTM, Graph-based=LSR2020.10 | 54.18 | 52.15 | — | — | |
| GloVe+LSRBackbone=GloVe2021.02 | 54.18 | 52.15 | — | — | |
| LSR-Gloveembeddings=Glove2021.06 | 54.18 | — | — | — | |
| BERT-TSbackbone=BASE2020.04 | 53.92 | — | — | — | |
| BERT-TS_BASEBackbone=BERT-Base, Architecture=Two-Stage2020.10 | 53.92 | — | — | — | |
| BERT Two-Phase2021.02 | 53.92 | — | — | — | |
| Two-StepTransformer-type model for document encoding=true2021.02 | 53.92 | — | — | — | |
| BERT-Two-StepBackbone=BERT-base2021.06 | 53.92 | — | — | — | |
| HIN-Gloveembeddings=Glove2021.06 | 53.3 | — | — | — | |
| BERT_BASEBackbone=BERT-Base2020.10 | 53.2 | — | — | — | |
| BERT_basePre-trained=true2022.02 | 53.2 | — | — | — | |
| BERTBackbone=BERT-base2021.06 | 53.2 | — | — | — | |
| BERTBackbone=BERT-base, Architecture=Transformer-based2021.09 | 53.2 | — | — | — | |
| EoG*2021.02 | 51.82 | 49.48 | — | — | |
| EoG2021.06 | 51.82 | — | — | — |