Relation Extraction on ChemProt
83.64F1 ScoreSciBERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SciBERT2021.04 | 83.64 | — | — | |
| BioMegatronNumber of Parameters=345m, Vocabulary=Bio-vocab-50k, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 77 | 74.5 | 79.7 | |
| BioBERT2021.04 | 76.46 | 77.02 | 75.9 | |
| PubMedBERTNumber of Parameters=110m, Vocabulary=PubMedBERT-uncased (30k), Fine-tuning=30 epochs2020.10 | 75.6 | 73.6 | 77.7 | |
| BioMegatronNumber of Parameters=345m, Vocabulary=Bio-vocab-30k, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 75.1 | 77.8 | 72.5 | |
| BioBERTNumber of Parameters=110m, Vocabulary=BERT-cased, Fine-tuning=30 epochs2020.10 | 74.8 | 76.5 | 73.3 | |
| BlueBERT2021.04 | 74.4 | — | — | |
| BioMegatronNumber of Parameters=800m, Vocabulary=BERT-cased, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 74.3 | 80.4 | 68.9 | |
| ELECTRAMed2021.04 | 72.94 | 75.47 | 70.67 | |
| BioMegatronNumber of Parameters=1.2b, Vocabulary=BERT-uncased, Fine-tuning=30 epochs, Pre-training=Fine-tuned from general domain model2020.10 | 72.9 | 82 | 65.6 |