Document-level Relation Extraction on CDR (test)
77.06F1 ScoreDense-CCNet
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Dense-CCNetbackbone=SciBERT_base2022.03 | 77.06 | — | — | |
| DocuNetbackbone=SciBERT_base2022.03 | 76.3 | — | — | |
| SIREbackbone=BioBERT2021.06 | 70.8 | — | — | |
| ATLOPbackbone=SciBERT_base2022.03 | 69.4 | — | — | |
| Zhou et al.Evaluation protocol=pipeline-based2022.04 | 69.4 | — | — | |
| Xu et al.Evaluation protocol=pipeline-based2022.04 | 68.7 | — | — | |
| GLREbackbone=BioBERT2021.06 | 68.5 | — | — | |
| GLRE2022.03 | 68.5 | — | — | |
| seq2relEvaluation protocol=pipeline-based, Entity hinting=true, Matching criteria=standard2022.04 | 67.2 | 68.2 | 66.2 | |
| seq2relEvaluation protocol=pipeline-based, Entity hinting=true, Matching criteria=relaxed2022.04 | 67.2 | 68.2 | 66.2 | |
| Minh Tran et al.Evaluation protocol=pipeline-based2022.04 | 66.1 | — | — | |
| Lai and LuEvaluation protocol=pipeline-based2022.04 | 66 | 64.9 | 67.1 | |
| DHG2022.03 | 65.9 | — | — | |
| SciBERTvariant=base2022.03 | 65.1 | — | — | |
| LSR2021.06 | 64.8 | — | — | |
| LSR2022.03 | 64.8 | — | — | |
| Nan et al.Evaluation protocol=pipeline-based2022.04 | 64.8 | — | — | |
| EoG2021.06 | 63.6 | — | — | |
| EoG2022.03 | 63.6 | — | — | |
| Christopoulou et al.Evaluation protocol=pipeline-based2022.04 | 63.6 | 62.1 | 65.2 | |
| BRAN2021.06 | 62.1 | — | — | |
| BRAN2022.03 | 62.1 | — | — | |
| seq2relEvaluation protocol=end-to-end, Entity hinting=false, Matching criteria=relaxed2022.04 | 52.4 | 56.6 | 48.8 | |
| seq2relEvaluation protocol=end-to-end, Entity hinting=false, Matching criteria=standard2022.04 | 40.2 | 43.5 | 37.5 |