Question Answering on BioASQ 8b (test)
46.5Exact F1BioBERT_large + Tagger (LIQUID)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BioBERT_large + Tagger (LIQUID)Training Protocol=synthetic & labeled (D -> D), Backbone=BioBERT-large, Architecture=Sequence tagging model2023.02 | 46.5 | 38.5 | 58.8 | 72.3 | 68.9 | 76.1 | |
| BioBERT_large + TaggerTraining Protocol=labeled only (D), Backbone=BioBERT-large, Architecture=Sequence tagging model2023.02 | 45 | 34.7 | 64 | 72.2 | 65.8 | 80 | |
| BioBERT_base + Single-span (LIQUID)Training Protocol=synthetic & labeled (D -> D), Backbone=BioBERT-base, Architecture=Single-span extractive model2023.02 | 44.2 | 41.4 | 47.5 | 65.2 | 65.4 | 65 | |
| BioBERT_base + Tagger (LIQUID)Training Protocol=synthetic & labeled (D -> D), Backbone=BioBERT-base, Architecture=Sequence tagging model2023.02 | 44.2 | 36.6 | 55.8 | 69.4 | 67.3 | 71.7 | |
| BioBERT_base + TaggerTraining Protocol=labeled only (D), Backbone=BioBERT-base, Architecture=Sequence tagging model2023.02 | 41.8 | 33.5 | 55.5 | 67.6 | 64 | 71.5 | |
| BioBERT_base + Single-spanTraining Protocol=labeled only (D), Backbone=BioBERT-base, Architecture=Single-span extractive model2023.02 | 34.4 | 44.9 | 27.9 | 53.5 | 40.2 | 79.9 |