Document Classification on HoC (test)
85.12F1 (sample average)BioGPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BioGPT2022.10 | 85.12 | — | — | — | |
| BioLinkBERTSize=Base2022.10 | 84.35 | — | — | — | |
| PubMedBERTSize=Large2022.10 | 82.7 | — | — | — | |
| PubMedBERT2022.10 | 82.32 | — | — | — | |
| GPT-2Size=Medium2022.10 | 81.84 | — | — | — | |
| BioBERT2022.10 | 81.54 | — | — | — | |
| SciFiveModel Size=Base, Pre-training=PubMed+PMC2021.05 | 0.873 | 0.8611 | 0.8621 | — | |
| BioBERTModel Size=Large2021.05 | 0.8608 | — | — | — | |
| SciFiveModel Size=Large, Pre-training=PubMed+PMC2021.05 | 0.8608 | — | — | — | |
| BlueBERTModel Size=Large2021.05 | 0.8603 | — | — | — | |
| SciFiveModel Size=Large, Pre-training=PMC2021.05 | 0.8603 | — | — | — | |
| BlueBERTModel Size=Base2021.05 | 0.8599 | 0.8618 | 0.8617 | — | |
| BioBERTModel Size=Base2021.05 | 0.8589 | — | — | — | |
| T5Model Size=Large2021.05 | 0.8587 | — | — | — | |
| SciFiveModel Size=Large, Pre-training=PubMed2021.05 | 0.8587 | — | — | — | |
| SciFiveModel Size=Base, Pre-training=PubMed2021.05 | 0.8583 | 0.8608 | 0.862 | — | |
| SciFiveModel Size=Base, Pre-training=PMC2021.05 | 0.8568 | 0.8602 | 0.8595 | — | |
| T5Model Size=Base2021.05 | 0.853 | — | — | — | |
| BERTModel Size=Base, Variant=base2021.05 | 0.8522 | 0.8627 | 0.8629 | — | |
| SOTAModel Size=Base2021.05 | 0.815 | 0.8555 | 0.8542 | — | |
| BioBERTSize=110M2024.03 | — | — | — | 81.54 | |
| BioGPT-largeSize=1.54B2024.03 | — | — | — | 84.4 | |
| BioGPT-medSize=345M2024.03 | — | — | — | 85.12 | |
| BioLinkBERT-baseSize=110M2024.03 | — | — | — | 84.35 | |
| BioLinkBERT-largeSize=340M2024.03 | — | — | — | 84.57 | |
| GPT-2medSize=345M2024.03 | — | — | — | 81.54 | |
| MediSwift-LargeSize=510M, Sparsity=dense2024.03 | — | — | — | 85.22 | |
| MediSwift-LargeSize=255M, Sparsity=50%2024.03 | — | — | — | 84.63 | |
| MediSwift-LargeSize=128M, Sparsity=75%2024.03 | — | — | — | 84.12 | |
| MediSwift-MedSize=302M, Sparsity=dense2024.03 | — | — | — | 85.15 | |
| MediSwift-MedSize=151M, Sparsity=50%2024.03 | — | — | — | 84.48 | |
| MediSwift-MedSize=75.5M, Sparsity=75%2024.03 | — | — | — | 83.95 | |
| MediSwift-XLSize=1.21B, Sparsity=dense2024.03 | — | — | — | 85.46 | |
| MediSwift-XLSize=605M, Sparsity=50%2024.03 | — | — | — | 84.98 | |
| MediSwift-XLSize=302M, Sparsity=75%2024.03 | — | — | — | 84.71 | |
| PubMedBERTSize=110M2024.03 | — | — | — | 82.32 |