Relation Extraction on GDA (test)
87.1F1 ScoreSAIS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SAISBackbone=SciBERT, Training Tasks=RE, CR, ET2021.09 | 87.1 | — | — | |
| DRE-MIR-SciBERTBackbone=SciBERT2022.04 | 86.4 | — | — | |
| SAISBackbone=SciBERT, Training Tasks=RE, ET2021.09 | 86.1 | — | — | |
| SAISBackbone=SciBERT, Training Tasks=RE, CR2021.09 | 85.4 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2021.09 | 85.3 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2021.09 | 85.3 | — | — | |
| DocuNet-SciBERTBackbone=SciBERT2022.04 | 85.3 | — | — | |
| DocuNet-SciBERTbaseBackbone=SciBERT-base2021.06 | 85.3 | — | — | |
| CGM2IRBackbone=SciBERTbase2022.01 | 84.7 | 88.3 | 59 | |
| SIRE-BioBERTBackbone=BioBERT2021.09 | 84.7 | — | — | |
| SIRE-BioBERTBackbone=BioBERT2021.09 | 84.7 | — | — | |
| EIDER (Rule)Backbone=SciBERT-base2021.06 | 84.54 | — | — | |
| SAISBackbone=SciBERT, Training Tasks=RE2021.09 | 84.5 | — | — | |
| SciBERT-ATLOPEncoder=SciBERT2020.10 | 83.9 | — | — | |
| SSAN BiaffineBackbone=BERT Large, Transformation Type=Biaffine2021.02 | 83.9 | 86.9 | 63.9 | |
| ATLOPBackbone=SciBERTbase2022.01 | 83.9 | 87.3 | 52.9 | |
| ATLOP-SciBERTBackbone=SciBERT-base2021.06 | 83.9 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2021.09 | 83.9 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2021.09 | 83.9 | — | — | |
| ATLOP-SciBERTBackbone=SciBERT2022.04 | 83.9 | — | — | |
| ATLOP-SciBERTbaseBackbone=SciBERT-base2021.06 | 83.9 | — | — | |
| SSAN DecompBackbone=BERT Large, Transformation Type=Decomposed Linear2021.02 | 83.8 | 86.6 | 65 | |
| SSAN BiaffineBackbone=SciBERT, Transformation Type=Biaffine2021.02 | 83.7 | 86.6 | 65.3 | |
| SSAN-SciBERTBackbone=SciBERT2021.09 | 83.7 | — | — | |
| SSAN-SciBERTBackbone=SciBERT2021.09 | 83.7 | — | — | |
| SciBERT BaselineBackbone=SciBERT2021.02 | 83.6 | 87.2 | 61.8 | |
| SSAN DecompBackbone=BERT Base, Transformation Type=Decomposed Linear2021.02 | 83.4 | 86.7 | 62.3 | |
| SciBERT-EEncoder=SciBERT2020.10 | 83.3 | — | — | |
| SSAN DecompBackbone=SciBERT, Transformation Type=Decomposed Linear2021.02 | 83.2 | 87 | 60 | |
| DHGBackbone=BERTbase2022.01 | 83.1 | 85.6 | 58.8 | |
| DHG-BERTBackbone=BERT-base2021.06 | 83.1 | — | — | |
| DHG2021.09 | 83.1 | — | — | |
| DHG2021.09 | 83.1 | — | — | |
| DHG2022.04 | 83.1 | — | — | |
| DHG2021.06 | 83.1 | — | — | |
| MRN2022.01 | 82.9 | 86.1 | 53.5 | |
| SciBERT (our implementation)Encoder=SciBERT2020.10 | 82.5 | — | — | |
| SciBERTBackbone=SciBERT-base2021.06 | 82.5 | — | — | |
| SciBERT2021.09 | 82.5 | — | — | |
| SciBERTBackbone=SciBERT2021.09 | 82.5 | — | — | |
| SciBERTBackbone=SciBERT2022.04 | 82.5 | — | — | |
| SciBERTbaseBackbone=SciBERT-base2021.06 | 82.5 | — | — | |
| LSRMDP Nodes=removed2020.05 | 82.2 | 85.4 | 51.1 | |
| LSR2020.10 | 82.2 | — | — | |
| LSR w/o MDPBackbone=None2021.02 | 82.2 | 85.4 | 51.1 | |
| LSR2022.01 | 82.2 | 85.4 | 51.1 | |
| LSR-BERTBackbone=BERT-base2021.06 | 82.2 | — | — | |
| LSR2021.09 | 82.2 | — | — | |
| LSR2021.09 | 82.2 | — | — | |
| LSR2022.04 | 82.2 | — | — | |
| LSR2021.06 | 82.2 | — | — | |
| SSAN BiaffineBackbone=BERT Base, Transformation Type=Biaffine2021.02 | 82.1 | 86.1 | 56.8 | |
| BERT Large BaselineBackbone=BERT Large2021.02 | 81.6 | 84.9 | 61.5 | |
| EoG2020.05 | 81.5 | 85.2 | 50 | |
| EoG2020.10 | 81.5 | — | — | |
| EoGBackbone=None2021.02 | 81.5 | 85.2 | 49.3 | |
| EoG2022.01 | 81.5 | 85.2 | 50 | |
| EoG2021.09 | 81.5 | — | — | |
| EoG2022.04 | 81.5 | — | — | |
| EoG2021.06 | 81.5 | — | — | |
| BERT Base BaselineBackbone=BERT Base2021.02 | 81.2 | 84.7 | 60.3 | |
| Fullgraph=fully connected2020.05 | 80.8 | 84.1 | 54.7 | |
| LSRMDP Nodes=included2020.05 | 79.6 | 83.1 | 49.6 | |
| LSRBackbone=None2021.02 | 79.6 | 83.1 | 49.6 | |
| NoInfinference component=removed2020.05 | 74.6 | 79.1 | 49.3 |