Named Entity Recognition on NCBI (Macro F1)
82.1Macro F1PubMedBERT
Evaluation results
| Method | Links | |
|---|---|---|
| PubMedBERTCtx=512, Model Size=Base2026.05 | 82.1 | |
| MLM baselineCtx=8192, Model Size=Large 350M, Training Tokens=50B tokens2026.05 | 81.8 | |
| CLM detourCtx=8192, Model Size=Large 350M, Training Tokens=50B tokens2026.05 | 81.7 | |
| CLM detourCtx=8192, Model Size=Base 150M, Training Tokens=10B tokens2026.05 | 80.4 | |
| MLM baselineCtx=8192, Model Size=Base 150M, Training Tokens=50B tokens2026.05 | 80.3 | |
| CLM detourCtx=8192, Model Size=Base 150M, Training Tokens=50B tokens2026.05 | 80.1 | |
| MLM baselineCtx=8192, Model Size=Base 150M, Training Tokens=10B tokens2026.05 | 79.2 | |
| BioClinical-ModernBERTCtx=8192, Model Size=Base2026.05 | 78.7 | |
| ModernBERT-baseCtx=8192, Model Size=Base2026.05 | 77.7 |