Subcode-level classification on PVminer
83.23F1 (mean)TAB-PO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TAB-POModel=Llama-3.3-70B-Instruct2026.02 | 83.23 | — | — | — | — | 2.18 | |
| TAB-POModel=Llama-3.1-8B-Instruct2026.02 | 80.63 | — | — | — | — | 1.16 | |
| PV-BERT-baseOriginal identifier=PV-BERT-base2026.02 | 80.14 | 84.17 | 0.9 | 76.48 | 0.38 | 0.35 | |
| SFTModel=Llama-3.3-70B-Instruct2026.02 | 80.13 | — | — | — | — | 0.57 | |
| PV-BERT-largeOriginal identifier=PV-BERT-large2026.02 | 79.84 | 82.58 | 0.53 | 77.28 | 0.38 | 0.19 | |
| TwHIN-BERT-baseOriginal identifier=Twitter/twhin-bert-base2026.02 | 78.76 | 81.14 | 0.79 | 76.52 | 0.09 | 0.33 | |
| BERT-base-uncasedOriginal identifier=bert-base-uncased2026.02 | 78.18 | 81.9 | 0.93 | 74.8 | 1.33 | 0.95 | |
| BERT-large-uncasedOriginal identifier=bert-large-uncased2026.02 | 78.15 | 80.88 | 1.48 | 75.64 | 3.63 | 2.63 | |
| BioBERT v1.1Original identifier=dmis-lab/biobert-v1.12026.02 | 76.99 | 81.65 | 0.39 | 72.85 | 1.47 | 0.83 | |
| SciBERTOriginal identifier=allenai/scibert-scivocab-uncased2026.02 | 76.97 | 81.07 | 0.48 | 73.27 | 0.75 | 0.59 | |
| TAB-POModel=Llama-3.2-3B-Instruct2026.02 | 76.9 | — | — | — | — | 1.44 | |
| Bio_ClinicalBERTOriginal identifier=emilyalsentzer/Bio_ClinicalBERT2026.02 | 76.24 | 81.5 | 0.96 | 71.63 | 1.05 | 0.84 | |
| SapBERTOriginal identifier=cambridgeltl/SapBERT-from-PubMedBERT-fulltext2026.02 | 75.94 | 80.09 | 0.3 | 72.2 | 0.42 | 0.37 | |
| TAB-POModel=Qwen2.5-1.5B-Instruct2026.02 | 75.22 | — | — | — | — | 0.22 | |
| SFTModel=Llama-3.1-8B-Instruct2026.02 | 74.46 | — | — | — | — | 4.12 | |
| SFTModel=Llama-3.2-3B-Instruct2026.02 | 69.64 | — | — | — | — | 5.8 | |
| SFTModel=Qwen2.5-1.5B-Instruct2026.02 | 66.91 | — | — | — | — | 4.69 |