Question Answering on PubMedQA (Accuracy, Macro-F1)
73AccuracyBioMamba-2.7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BioMamba-2.7B# Parameters=2.7B, Training Mode=supervised fine-tuning2024.08 | 73 | 77.3 | |
| BioMamba-1.3B# Parameters=1.3B, Training Mode=supervised fine-tuning2024.08 | 70 | 74 | |
| BioMamba-780M# Parameters=780M, Training Mode=supervised fine-tuning2024.08 | 67.5 | 71.1 | |
| BioMamba-370M# Parameters=370M, Training Mode=supervised fine-tuning2024.08 | 66 | 69 | |
| BioMamba-130M# Parameters=130M, Training Mode=supervised fine-tuning2024.08 | 63 | 66.1 |