Named Entity Recognition on CADEC (test)
88.95F1 ScoreBiLSTM-CNN-Char
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BiLSTM-CNN-CharEmbeddings=BERT, Evaluation Protocol=relax, Averaging=macro2022.01 | 88.95 | 88.63 | 89.32 | |
| BiLSTM-CNN-CharEmbeddings=GLoVe, Evaluation Protocol=relax, Averaging=macro2022.01 | 88.5 | 89.04 | 88.01 | |
| BiLSTM-CNN-CharEmbeddings=BERT, Evaluation Protocol=relax, Averaging=micro2022.01 | 86.88 | 86.14 | 87.66 | |
| BiLSTM-CNN-CharEmbeddings=GLoVe, Evaluation Protocol=relax, Averaging=micro2022.01 | 86.23 | 86.36 | 86.13 | |
| BiLSTM-CNN-CharEmbeddings=BERT, Evaluation Protocol=strict, Averaging=macro2022.01 | 78.76 | 78.53 | 79.03 | |
| BiLSTM-CNN-CharEmbeddings=GLoVe, Evaluation Protocol=strict, Averaging=macro2022.01 | 77.62 | 78.14 | 77.14 | |
| BiLSTM-CNN-CharEmbeddings=BERT, Evaluation Protocol=strict, Averaging=micro2022.01 | 72.99 | 72.38 | 73.64 | |
| Stanovsky et al. (2017)Averaging=macro, Evaluation Protocol=strict2022.01 | 71.9 | — | — | |
| BiLSTM-CNN-CharEmbeddings=GLoVe, Evaluation Protocol=strict, Averaging=micro2022.01 | 71.75 | 71.87 | 71.67 | |
| Span-based, BERTArchitecture=Span-based, Encoder=BERT, Dep-guided GCN=true, Overlap Relation=true2021.06 | 69.5 | — | — | |
| Transition-based, ELMoArchitecture=Transition-based, Encoder=ELMo, Related Work=Dai et al. (2020)2021.06 | 69 | — | — | |
| Span-based, BERT (w/o Dep-guided GCN)Architecture=Span-based, Encoder=BERT, Dep-guided GCN=false2021.06 | 68.8 | — | — | |
| Span-based, BERT (w/o Overlap Relation)Architecture=Span-based, Encoder=BERT, Overlap Relation=false2021.06 | 68.8 | — | — | |
| LSTM-CRF, MultilabelLabeling Scheme=Multilabel, Related Work=Tang et al. (2018)2021.06 | 66.3 | — | — | |
| Span-based, PubMed embeddingsArchitecture=Span-based, Encoder=PubMed word embeddings, BERT=false2021.06 | 64.9 | — | — | |
| CRF, BIOHDLabeling Scheme=BIOHD, Related Work=Metke-Jimenez and Karimi (2016)2021.06 | 60.2 | — | — |