Question Answering on BioASQ 7b (test)
24.07Strict AccuracyBioBERT-v1.1
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BioBERT-v1.1Model Size=110M, Note=Teacher model2022.09 | 24.07 | 34.56 | 28.41 | |
| CompactBioBERTModel Size=60M, Distillation Source=BioBERT-v1.12022.09 | 22.83 | 29.01 | 25.06 | |
| DistilBERTModel Size=60M, Distillation Source=BioBERT-v1.12022.09 | 20.98 | 29.62 | 24.34 | |
| DistilBioBERTModel Size=60M, Distillation Source=BioBERT-v1.12022.09 | 20.98 | 28.39 | 23.79 | |
| TinyBioBERTModel Size=15M, Distillation Source=BioBERT-v1.12022.09 | 20.98 | 30.86 | 25.05 |