Relation Extraction on CDR (test)
79F1 ScoreSAIS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAISBackbone=SciBERT, Training Tasks=RE, CR, ET2021.09 | 79 | — | — | |
| DRE-MIR-SciBERTBackbone=SciBERT2022.04 | 76.8 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2021.09 | 76.3 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2021.09 | 76.3 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2022.04 | 76.3 | — | — | |
| DocuNet-SciBERTbaseBackbone=SciBERT-base2021.06 | 76.3 | — | — | |
| SAISBackbone=SciBERT, Training Tasks=RE, ET2021.09 | 75.9 | — | — | |
| SAISBackbone=SciBERT, Training Tasks=RE, CR2021.09 | 74.5 | — | — | |
| CGM2IRBackbone=SciBERTbase2022.01 | 73.8 | 79.2 | 55.1 | |
| SAISBackbone=SciBERT, Training Tasks=RE2021.09 | 72.8 | — | — | |
| SIRE-BioBERTBackbone=BioBERT2021.09 | 70.8 | — | — | |
| SIRE-BioBERTBackbone=BioBERT2021.09 | 70.8 | — | — | |
| EIDER (Rule)Backbone=SciBERT-base2021.06 | 70.63 | — | — | |
| SciBERT-ATLOPEncoder=SciBERT2020.10 | 69.4 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT-base2021.06 | 69.4 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2021.09 | 69.4 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2021.09 | 69.4 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2022.04 | 69.4 | — | — | |
| ATLOP-SciBERTbaseBackbone=SciBERT-base2021.06 | 69.4 | — | — | |
| ATLOPBackbone=SciBERTbase2022.01 | 69.2 | 74.2 | 52.6 | |
| SSAN_BiaffineBackbone=SciBERT2021.02 | 68.7 | 74.5 | 56.2 | |
| SSAN-SciBERTBackbone=SciBERT2021.09 | 68.7 | — | — | |
| SSAN-SciBERTBackbone=SciBERT2021.09 | 68.7 | — | — | |
| GLRE-SciBERTBackbone=SciBERT-base2021.06 | 68.5 | — | — | |
| GLRE2021.09 | 68.5 | — | — | |
| GLRE2022.04 | 68.5 | — | — | |
| GLRE2021.06 | 68.5 | — | — | |
| Li et al.External resources / Additional training data usage=true2020.05 | 67.3 | 58.9 | — | |
| SSAN_DecompBackbone=SciBERT2021.02 | 67 | 72.6 | 55.8 | |
| SciBERT-EEncoder=SciBERT2020.10 | 65.9 | — | — | |
| CFER2020.12 | 65.9 | 70.7 | 57.8 | |
| DHGBackbone=BERTbase2022.01 | 65.9 | 70.1 | 54.6 | |
| MRN2022.01 | 65.9 | 70.4 | 54.2 | |
| DHG-BERTBackbone=BERT-base2021.06 | 65.9 | — | — | |
| DHG2021.09 | 65.9 | — | — | |
| DHG2021.09 | 65.9 | — | — | |
| DHG2022.04 | 65.9 | — | — | |
| DHG2021.06 | 65.9 | — | — | |
| SciBERT BaselineBackbone=SciBERT2021.02 | 65.8 | 71.9 | 53.3 | |
| SSAN_BiaffineBackbone=BERT Large2021.02 | 65.3 | 71.4 | 52 | |
| SciBERT (our implementation)Encoder=SciBERT2020.10 | 65.1 | — | — | |
| Panyam et al.external resources=true2021.02 | 65.1 | 65.1 | 45.7 | |
| SciBERTBackbone=SciBERT-base2021.06 | 65.1 | — | — | |
| SciBERT2021.09 | 65.1 | — | — | |
| SciBERTBackbone=SciBERT2021.09 | 65.1 | — | — | |
| SciBERTBackbone=SciBERT2022.04 | 65.1 | — | — | |
| SciBERTbaseBackbone=SciBERT-base2021.06 | 65.1 | — | — | |
| LSR w/o MDP NodesExternal resources / Additional training data usage=false2020.05 | 64.8 | 68.9 | 53.1 | |
| LSR2020.10 | 64.8 | — | — | |
| LSR w/o MDP2021.02 | 64.8 | 68.9 | 53.1 | |
| LSR w/o MDP Nodesvariant=without MDP Nodes2020.12 | 64.8 | 68.9 | 53.1 | |
| LSR2022.01 | 64.8 | 68.9 | 53.1 | |
| LSR-BERTBackbone=BERT-base2021.06 | 64.8 | — | — | |
| LSR2021.09 | 64.8 | — | — | |
| LSR2021.09 | 64.8 | — | — | |
| LSR2022.04 | 64.8 | — | — | |
| LSR2021.06 | 64.8 | — | — | |
| SSAN_DecompBackbone=BERT Large2021.02 | 64.5 | 71.2 | 50.2 | |
| Christopoulou et al.External resources / Additional training data usage=false2020.05 | 63.6 | 68.2 | 50.9 | |
| EoG2020.10 | 63.6 | — | — | |
| EoG2021.02 | 63.6 | 68.2 | 50.9 | |
| BERT Large BaselineBackbone=BERT Large2021.02 | 63.6 | 70.8 | 49 | |
| EoG2020.12 | 63.6 | 68.2 | 50.9 | |
| EoG2022.01 | 63.6 | 68.2 | 50.9 | |
| EoG2021.09 | 63.6 | — | — | |
| EoG2022.04 | 63.6 | — | — | |
| EoG2021.06 | 63.6 | — | — | |
| Peng et al.External resources / Additional training data usage=true2020.05 | 63.1 | — | — | |
| SSAN_BiaffineBackbone=BERT Base2021.02 | 62.7 | 70.4 | 44.7 | |
| Nguyen and VerspoorExternal resources / Additional training data usage=false2020.05 | 62.3 | — | — | |
| CNN2020.10 | 62.3 | — | — | |
| CNN+CNNchar2021.02 | 62.3 | — | — | |
| CNN2021.09 | 62.3 | — | — | |
| Verga et al.External resources / Additional training data usage=false2020.05 | 62.1 | — | — | |
| BRAN2020.10 | 62.1 | — | — | |
| BRAN2021.02 | 62.1 | — | — | |
| BRAN2020.12 | 62.1 | — | — | |
| BRAN2021.09 | 62.1 | — | — | |
| BRAN2022.04 | 62.1 | — | — | |
| BRAN2021.06 | 62.1 | — | — | |
| Zheng et al.External resources / Additional training data usage=true2020.05 | 61.5 | — | — | |
| BERT Base BaselineBackbone=BERT Base2021.02 | 61.4 | 69.3 | 44.9 | |
| Gu et al.External resources / Additional training data usage=false2020.05 | 61.3 | 57.2 | 11.7 | |
| Gu et al.2021.02 | 61.3 | 57.2 | 11.7 | |
| LSRExternal resources / Additional training data usage=false2020.05 | 61.2 | 66.2 | 50.3 | |
| LSR2021.02 | 61.2 | 66.2 | 50.3 | |
| SSAN_DecompBackbone=BERT Base2021.02 | 61.2 | 68.6 | 45.1 | |
| LSR2020.12 | 61.2 | 66.2 | 50.3 | |
| Panyam et al.External resources / Additional training data usage=true2020.05 | 60.3 | 65.1 | 45.7 | |
| Sahu et al.External resources / Additional training data usage=false2020.05 | 58.6 | — | — | |
| GCNN2021.02 | 58.6 | — | — | |
| GCNN2020.12 | 58.6 | — | — | |
| Li et al.external resources=true2021.02 | — | 58.9 | — |