ICD-9-CM code extraction on Technetium-I (test)
76Micro-F1ProtactiniumBERT-100M
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ProtactiniumBERT-100MBackbone=Transformer encoder (12 layers, 12 attention heads, hidden size 768), Parameters=~100M, Context length=512 tokens with sliding window2026.01 | 76 | 64 | 79 | |
| ClinicalBERT2026.01 | 73 | 60 | 77 | |
| CAML (CNN+attn)Architecture=CNN+attention2026.01 | 70 | 56 | 74 |