Relation Extraction on ChemProt (test)
83.64Micro F1SciBERT
Evaluation Results
| Method | Links | |
|---|---|---|
| SciBERTtraining_mode=finetune2019.03 | 83.64 | |
| SCIBERTEvaluation Protocol=Finetune2019.03 | 83.64 | |
| DARTtraining_setting=Full2021.08 | 81 | |
| Fine-tuningtraining_setting=Full2021.08 | 79.5 | |
| BERT-BaseEvaluation Protocol=Finetune2019.03 | 79.14 | |
| LM-BFFtraining_setting=Full2021.08 | 79.1 | |
| BioBERTtraining_mode=finetune2019.03 | 76.68 | |
| SOTA (Kringelum et al., 2016)2019.03 | 76.68 | |
| SCIBERTEvaluation Protocol=Frozen2019.03 | 75.03 | |
| BERT-BaseEvaluation Protocol=Frozen2019.03 | 68.21 | |
| DARTK=322021.08 | 63.1 | |
| DARTK=162021.08 | 60.8 | |
| MixDAK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 60.6 | |
| LM-BFFK=322021.08 | 60 | |
| FTK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 57.9 | |
| DARTK=82021.08 | 57.2 | |
| LM-BFFK=162021.08 | 56.1 | |
| LM-BFFK=82021.08 | 55 | |
| PFK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 53.7 | |
| Fine-tuningK=322021.08 | 52.5 | |
| HOK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 47.1 | |
| Fine-tuningK=162021.08 | 41.5 | |
| Fine-tuningK=82021.08 | 30.2 | |
| LOK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 24.2 | |
| PTK=16, backbone=RoBERTa, protocol=few-shot2023.06 | 17.1 |