Named Entity Recognition on BC2GM local evaluation (test)
87.62F1 ScoreBioBERT-v1.1
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BioBERT-v1.1Number of Parameters=> 60M2022.09 | 87.62 | 87.07 | 88.17 | |
| CompactBioBERTNumber of Parameters=> 60M2022.09 | 86.71 | 85.55 | 87.9 | |
| DistilBioBERTNumber of Parameters=> 60M2022.09 | 86.6 | 86.11 | 87.1 | |
| HGN (BioBERT) (MLP)extra resources=false, backbone=BioBERT, aggregation=MLP2022.05 | 85.65 | 84.93 | 86.37 | |
| HGN (BioBERT) (DOT)extra resources=false, backbone=BioBERT, aggregation=DOT2022.05 | 85.54 | 85.21 | 85.88 | |
| HGN (BioBERT) (ADD)extra resources=false, backbone=BioBERT, aggregation=ADD2022.05 | 85.35 | 85.21 | 85.5 | |
| HGN (BioBERT) (CONCAT)extra resources=false, backbone=BioBERT, aggregation=CONCAT2022.05 | 85.12 | 83.91 | 86.36 | |
| KEBIO-LMextra resources=true2022.05 | 85.1 | — | — | |
| MT-BIONERextra resources=true2022.05 | 84.78 | 84.42 | 85.14 | |
| BioBERTextra resources=false2022.05 | 84.72 | 84.32 | 85.12 | |
| DistilBERTNumber of Parameters=> 60M2022.09 | 84.61 | 83.93 | 85.29 | |
| TinyBioBERTNumber of Parameters=15M2022.09 | 82.52 | 80.49 | 84.65 | |
| BILMextra resources=true2022.05 | 81.69 | 81.81 | 81.57 | |
| MTM-CWextra resources=true2022.05 | 80.74 | 82.1 | 79.42 | |
| MTM Wang et al. (2018)Model Type=Multi-task, Protocol=Local evaluation2019.09 | 80.7 | — | — | |
| MTM (ours)Model Type=Multi-task, Protocol=Local evaluation2019.09 | 80.3 | — | — | |
| STMModel Type=Single-task, Protocol=Local evaluation2019.09 | 79.9 | — | — | |
| Unified-00Model Type=Proposed Unified Model, Protocol=Local evaluation2019.09 | 79.1 | — | — | |
| Unified-11Model Type=Proposed Unified Model, Protocol=Local evaluation2019.09 | 74.2 | — | — | |
| MTM Crichton et al. (2017)Model Type=Multi-task, Protocol=Local evaluation2019.09 | 73.2 | — | — | |
| Unified-01Model Type=Proposed Unified Model, Protocol=Local evaluation2019.09 | 70.9 | — | — |