Named Entity Recognition on NCBI-disease
90.48F1 ScoreInstructUIE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InstructUIE2023.04 | 90.48 | — | — | — | |
| Spark-BiomedicalImplementation=Spark-Biomedical2020.11 | 89.13 | — | — | — | |
| Supervised BERT-NERSupervision Type=Fully Supervised, Pre-trained Model=bioBERT2021.05 | 88.89 | 87.05 | 90.82 | — | |
| BioMegatronNumber of Parameters=800m, Vocabulary=BERT-cased, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 87.8 | 87 | 88.8 | — | |
| RDANERtraining_data=full2021.01 | 87.71 | — | — | — | |
| BioBERTNumber of Parameters=110m, Vocabulary=BERT-cased, Fine-tuning=30 epochs2020.10 | 87.5 | 85 | 90 | — | |
| Stanza2020.11 | 87.49 | — | — | — | |
| Spark-GloVe6BImplementation=Spark-GloVe6B2020.11 | 87.19 | — | — | — | |
| BioMegatronNumber of Parameters=345m, Vocabulary=Bio-vocab-30k, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 87.1 | 85.6 | 88.6 | — | |
| BioMegatronNumber of Parameters=345m, Vocabulary=Bio-vocab-50k, Fine-tuning=30 epochs, Pre-training=From scratch on PubMed2020.10 | 87 | 83.7 | 90.4 | — | |
| UniversalNERParameters=7B2026.04 | 86.96 | — | — | — | |
| ProUIEParameters=4B2026.04 | 86.95 | — | — | — | |
| PubMedBERTNumber of Parameters=110m, Vocabulary=PubMedBERT-uncased (30k), Fine-tuning=30 epochs2020.10 | 86.8 | 85.9 | 87.7 | — | |
| BioMegatronNumber of Parameters=1.2b, Vocabulary=BERT-uncased, Fine-tuning=30 epochs, Pre-training=Fine-tuned from general domain model2020.10 | 86.7 | 83.5 | 90.1 | — | |
| GollIEParameters=13B2026.04 | 86.5 | — | — | — | |
| InstructUIEParameters=11B2026.04 | 86.21 | — | — | — | |
| SpERTtraining_data=full, paradigm=multi-task learning2021.01 | 86.12 | — | — | — | |
| GollIEParameters=34B2026.04 | 85.8 | — | — | — | |
| GollIEParameters=7B2026.04 | 85.4 | — | — | — | |
| CHMM-ALTSupervision Type=Distant Supervision, Pre-trained Model=bioBERT2021.05 | 85.02 | 87.92 | 82.47 | — | |
| DyGIE++training_data=full, paradigm=multi-task learning2021.01 | 84.11 | — | — | — | |
| KnowCoderParameters=7B2026.04 | 83.8 | — | — | — | |
| CHMM + BERT-NERSupervision Type=Distant Supervision, Pre-trained Model=bioBERT2021.05 | 82.87 | 89.42 | 77.22 | — | |
| best consensusSupervision Type=Oracle2021.05 | 81.6 | 100 | 68.91 | — | |
| SwellSharktraining_data=full, paradigm=distantly supervised learning2021.01 | 80.8 | — | — | — | |
| SwellShark (hand-tuned)Supervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 80.8 | 81.6 | 80.1 | — | |
| BOND-MVSupervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 80.33 | 84.77 | 76.34 | — | |
| BERT-base2026.04 | 80.2 | — | — | — | |
| Linked HMMSupervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 79.03 | 83.46 | 75.05 | — | |
| CHMMSupervision Type=Unsupervised label denoiser2021.05 | 78.88 | 93.37 | 68.28 | — | |
| AutoNERtraining_data=full, paradigm=distantly supervised learning2021.01 | 75.52 | — | — | — | |
| AutoNERSupervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 75.52 | 79.42 | 71.98 | — | |
| Majority VotingSupervision Type=Unsupervised label denoiser2021.05 | 73.94 | 79.76 | 68.91 | — | |
| SnorkelSupervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 73.41 | 71.1 | 76 | — | |
| HMMSupervision Type=Unsupervised label denoiser2021.05 | 73.06 | 83.88 | 64.7 | — | |
| CHMM-i.i.d.Supervision Type=Unsupervised label denoiser2021.05 | 71.69 | 83.49 | 62.87 | — | |
| SwellShark (noun-phrase)Supervision Type=Distant Supervision, Label Denoiser Status=Active2021.05 | 67.1 | 64.7 | 69.7 | — | |
| Bert-baseBackbone=Bert-base2023.04 | — | — | — | 80.2 | |
| InstructUIEBackbone=11B FlanT52023.04 | — | — | — | 90.23 |