Document-level Relation Extraction on GDA (test)
86.44F1 ScoreDense-CCNet
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Dense-CCNetbackbone=SciBERT_base2022.03 | 86.44 | — | — | |
| DocuNetbackbone=SciBERT_base2022.03 | 85.3 | — | — | |
| seq2relEvaluation protocol=pipeline-based, Entity hinting=true, Matching criteria=relaxed2022.04 | 85 | 84.5 | 85.4 | |
| seq2relEvaluation protocol=pipeline-based, Entity hinting=true, Matching criteria=standard2022.04 | 84.9 | 84.4 | 85.3 | |
| SIREbackbone=BioBERT2021.06 | 84.7 | — | — | |
| ATLOPbackbone=SciBERT_base2022.03 | 83.9 | — | — | |
| Zhou et al.Evaluation protocol=pipeline-based2022.04 | 83.9 | — | — | |
| Xu et al.Evaluation protocol=pipeline-based2022.04 | 83.7 | — | — | |
| DHG2022.03 | 83.1 | — | — | |
| Minh Tran et al.Evaluation protocol=pipeline-based2022.04 | 82.8 | — | — | |
| SciBERTvariant=base2022.03 | 82.5 | — | — | |
| LSR2021.06 | 82.2 | — | — | |
| LSR2022.03 | 82.2 | — | — | |
| Nan et al.Evaluation protocol=pipeline-based2022.04 | 82.2 | — | — | |
| EoG2021.06 | 81.5 | — | — | |
| EoG2022.03 | 81.5 | — | — | |
| Christopoulou et al.Evaluation protocol=pipeline-based2022.04 | 81.5 | — | — | |
| seq2relEvaluation protocol=end-to-end, Entity hinting=false, Matching criteria=relaxed2022.04 | 70.5 | 70.3 | 70.8 | |
| seq2relEvaluation protocol=end-to-end, Entity hinting=false, Matching criteria=standard2022.04 | 55.2 | 55 | 55.4 |