Code-level classification on PVminer v1.0 (test)
89.47Precision (mean)PV-BERT-large
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PV-BERT-largeFramework=PVminer, Configuration=large2026.02 | 89.47 | 0.62 | 76.11 | 0.95 | 82.25 | 0.33 | |
| PV-BERT-baseFramework=PVminer, Configuration=base2026.02 | 88.75 | 1.04 | 74.85 | 0.68 | 81.2 | 0.3 | |
| bert-base-uncasedFramework=PVminer, Configuration=base, Casing=uncased2026.02 | 88.52 | 0.64 | 74.61 | 0.47 | 80.97 | 0.05 | |
| dmis-lab/biobert-v1.1Framework=PVminer2026.02 | 86.95 | 0.24 | 71.78 | 0.7 | 78.64 | 0.49 | |
| emilyalsentzer/Bio_ClinicalBERTFramework=PVminer2026.02 | 86.52 | 0.44 | 70.64 | 0.86 | 77.77 | 0.39 | |
| bert-large-uncasedFramework=PVminer, Configuration=large, Casing=uncased2026.02 | 86.01 | 0.7 | 75.15 | 1.77 | 80.21 | 1.25 | |
| allenai/scibert_scivocab_uncasedFramework=PVminer2026.02 | 85.96 | 0.45 | 72.5 | 0.95 | 78.65 | 0.38 | |
| Twitter/twhin-bert-baseFramework=PVminer, Configuration=base2026.02 | 85.56 | 1.21 | 74.37 | 0.39 | 79.57 | 0.47 | |
| cambridgeltl/SapBERT-from-PubMedBERT-fulltextFramework=PVminer2026.02 | 84.93 | 0.3 | 71.9 | 0.52 | 77.87 | 0.42 |