List your company
ResearchFormerly WizWand

Named Entity Recognition on BC2GM local evaluation (test)

87.62F1 ScoreBioBERT-v1.1
70.231274.745679.2683.7744Sep 25, 2019Mar 22, 2020Sep 18, 2020Mar 17, 2021Sep 12, 2021Mar 11, 2022Sep 7, 2022
Updated 8mo ago

Evaluation results

MethodLinks
BioBERT-v1.1Number of Parameters=> 60M2022.0987.6287.0788.17
CompactBioBERTNumber of Parameters=> 60M2022.0986.7185.5587.9
DistilBioBERTNumber of Parameters=> 60M2022.0986.686.1187.1
HGN (BioBERT) (MLP)extra resources=false, backbone=BioBERT, aggregation=MLP2022.0585.6584.9386.37
HGN (BioBERT) (DOT)extra resources=false, backbone=BioBERT, aggregation=DOT2022.0585.5485.2185.88
HGN (BioBERT) (ADD)extra resources=false, backbone=BioBERT, aggregation=ADD2022.0585.3585.2185.5
HGN (BioBERT) (CONCAT)extra resources=false, backbone=BioBERT, aggregation=CONCAT2022.0585.1283.9186.36
KEBIO-LMextra resources=true2022.0585.1——
MT-BIONERextra resources=true2022.0584.7884.4285.14
BioBERTextra resources=false2022.0584.7284.3285.12
DistilBERTNumber of Parameters=> 60M2022.0984.6183.9385.29
TinyBioBERTNumber of Parameters=15M2022.0982.5280.4984.65
BILMextra resources=true2022.0581.6981.8181.57
MTM-CWextra resources=true2022.0580.7482.179.42
MTM Wang et al. (2018)Model Type=Multi-task, Protocol=Local evaluation2019.0980.7——
MTM (ours)Model Type=Multi-task, Protocol=Local evaluation2019.0980.3——
STMModel Type=Single-task, Protocol=Local evaluation2019.0979.9——
Unified-00Model Type=Proposed Unified Model, Protocol=Local evaluation2019.0979.1——
Unified-11Model Type=Proposed Unified Model, Protocol=Local evaluation2019.0974.2——
MTM Crichton et al. (2017)Model Type=Multi-task, Protocol=Local evaluation2019.0973.2——
Unified-01Model Type=Proposed Unified Model, Protocol=Local evaluation2019.0970.9——