Nested Named Entity Recognition on GENIA (test)
81.9F1 ScoreDSpERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DSpERTreporting_metric=best2022.10 | 81.9 | 82.31 | 81.49 | |
| PIQNBackbone=biobert-large2022.03 | 81.77 | 83.24 | 80.35 | |
| Shen et al. (2022)train_config=trained with both train and dev splits2022.10 | 81.77 | 83.24 | 80.35 | |
| DIFFUSIONNERCategory=Diffusion-based, Backbone=biobert-large2023.05 | 81.53 | 82.1 | 80.97 | |
| DSpERTreporting_metric=average2022.10 | 81.46 | 81.72 | 81.21 | |
| CNN_Nested_NER# Param (Million)=112.6, Data Source=Li et al. (2022), Backbone=BioBERT-base2022.08 | 81.4 | 83.18 | 79.7 | |
| Li et al. (2022a)Category=Span-based, Backbone=biobert-large2023.05 | 81.39 | 83.1 | 79.76 | |
| W2NER# Param (Million)=113.6, Data Source=Li et al. (2022), Backbone=BioBERT-base2022.08 | 81.39 | 83.1 | 79.76 | |
| Li et al. (2022)reporting_metric=average2022.10 | 81.39 | 83.1 | 79.76 | |
| CNN_Nested_NER# Param (Million)=128.42, Data Source=Yuan et al. (2022), Backbone=BioBERT-base2022.08 | 81.35 | 83.37 | 79.43 | |
| Yuan et al. (2022b)Category=Span-based, Backbone=biobert-large2023.05 | 81.23 | 80.42 | 82.06 | |
| TriaffineEncoder=BERT2021.10 | 81.23 | 80.42 | 82.06 | |
| Triaffine# Param (Million)=526.5, Data Source=Yuan et al. (2022), Backbone=BioBERT-base2022.08 | 81.23 | 80.42 | 82.06 | |
| BINDEREncoder=BERT-large/BioBERT-large2022.08 | 80.8 | 83.4 | 78.3 | |
| Shen et al. (2021)Category=Span-based, Backbone=biobert-large2023.05 | 80.54 | 80.19 | 80.89 | |
| Locate and LabelBackbone=BioBERT + BioWordvec2021.05 | 80.54 | 80.19 | 80.89 | |
| Shen et al.Encoder=BERT2021.10 | 80.54 | 80.19 | 80.89 | |
| Locate&Labelcontext_sentences=true, pos_tags=true, data_preprocessing=different2022.03 | 80.54 | 80.19 | 80.89 | |
| Shen et al. (2021a)2022.03 | 80.54 | 80.19 | 80.89 | |
| Locate and LabelEncoder=BERT2021.10 | 80.54 | 80.19 | 80.89 | |
| Shen et al. (2021)train_config=trained with both train and dev splits2022.10 | 80.54 | 80.19 | 80.89 | |
| Shen et al. (2021)Backbone=BioBERT2024.06 | 80.54 | — | — | |
| Yu et al. (2020)Category=Span-based, Backbone=biobert-large2023.05 | 80.5 | 81.8 | 79.3 | |
| Biaffine NER2020.05 | 80.5 | 81.8 | 79.3 | |
| Yu et al.2021.05 | 80.5 | 81.8 | 79.3 | |
| Yu et al. (2020)2022.03 | 80.5 | 81.8 | 79.3 | |
| BiaffineEncoder=BERT2021.10 | 80.5 | 81.8 | 79.3 | |
| Yu et al.Encoder=BERT-large/BioBERT2022.08 | 80.5 | 81.8 | 79.3 | |
| BINDEREncoder=BERT-base/BioBERT2022.08 | 80.5 | 81.5 | 79.6 | |
| Yu et al. (2020)train_config=trained with both train and dev splits2022.10 | 80.5 | 81.8 | 79.3 | |
| Yu et al. (2020)Backbone=BioBERT2024.06 | 80.5 | — | — | |
| Tan et al. (2021)Category=Generation-based, Backbone=biobert-large2023.05 | 80.44 | 82.31 | 78.66 | |
| Tan et al.Encoder=BERT2021.10 | 80.44 | 82.31 | 78.66 | |
| Seq2setcontext_sentences=true, pos_tags=true, data_preprocessing=different2022.03 | 80.44 | 82.31 | 78.66 | |
| Tan et al. (2021)2022.03 | 80.44 | 82.31 | 78.66 | |
| Sequence to SetEncoder=BERT2021.10 | 80.44 | 82.31 | 78.66 | |
| Tan et al. (2021)Backbone=BioBERT2024.06 | 80.44 | — | — | |
| Tan et al.Encoder=BERT-large/BioBERT2022.08 | 80.4 | 82.3 | 78.7 | |
| CNN_Nested_NER# Param (Million)=112.6, Data Source=This work, Backbone=BioBERT-base2022.08 | 80.33 | 81.52 | 79.17 | |
| W2NER†# Param (Million)=113.6, Data Source=This work, Reproduction=true, Backbone=BioBERT-base2022.08 | 80.32 | 81.58 | 79.11 | |
| CNN_Nested_NER (w.o. CNN)# Param (Million)=111.1, Data Source=Li et al. (2022), Backbone=BioBERT-base2022.08 | 80.21 | 80.66 | 79.76 | |
| CNN_Nested_NER (w.o. CNN)# Param (Million)=111.1, Data Source=Yuan et al. (2022), Backbone=BioBERT-base2022.08 | 80.16 | 80.87 | 79.47 | |
| Xu et al.Encoder=BERT2021.10 | 79.6 | 80.3 | 78.9 | |
| Xu et al. (2021)Backbone=BioBERT2024.06 | 79.6 | — | — | |
| CNN_Nested_NER# Param (Million)=112.2, Data Source=Wan et al. (2022), Backbone=BioBERT-base2022.08 | 79.42 | 81.05 | 77.87 | |
| PyramidEncoder=ALBERT2021.10 | 79.31 | 80.33 | 78.31 | |
| Wan et al. (2022)Category=Span-based, Backbone=biobert-large2023.05 | 79.3 | 77.92 | 80.74 | |
| SG# Param (Million)=112.7, Data Source=Wan et al. (2022), Backbone=BioBERT-base2022.08 | 79.3 | 77.92 | 80.74 | |
| Wan et al.Encoder=BERT-base2022.08 | 79.3 | 77.9 | 80.7 | |
| Yan et al. (2021b)Category=Generation-based, Backbone=biobert-large2023.05 | 79.23 | 78.87 | 79.6 | |
| Yan et al. (2021)2022.03 | 79.23 | 78.87 | 79.6 | |
| BartNEREncoder=BART2021.10 | 79.23 | 78.87 | 79.6 | |
| Yan et al. (2021)2022.10 | 79.23 | 78.87 | 79.6 | |
| CNN_Nested_NER (w.o. CNN)# Param (Million)=111.1, Data Source=This work, Backbone=BioBERT-base2022.08 | 79.22 | 78.59 | 79.85 | |
| Wang et al.Encoder=BERT-large/BioBERT2022.08 | 79.2 | 79.5 | 78.9 | |
| Wang et al. (2020)Category=Tagging-based, Backbone=biobert-large2023.05 | 79.19 | 79.45 | 78.94 | |
| Wang et al.suffix=2020a2021.05 | 79.19 | 79.45 | 78.94 | |
| Wang et al. (2020)Encoder=BERT2021.10 | 79.19 | 79.45 | 78.94 | |
| Pyramid-Basic2022.03 | 79.19 | 78.45 | 79.94 | |
| Wang et al. (2020a)2022.03 | 79.19 | 79.45 | 78.94 | |
| PyramidEncoder=BERT2021.10 | 79.19 | 79.45 | 78.94 | |
| Wang et al. (2020)Backbone=BioBERT2024.06 | 79.19 | — | — | |
| Zhang et al.Encoder=T5-base2022.08 | 79.1 | 81 | 77.2 | |
| Yan et al.Encoder=BERT2021.10 | 78.93 | 78.57 | 79.3 | |
| BARTNER2022.03 | 78.93 | 78.57 | 79.3 | |
| Li et al. (2020)Category=Span-based, Backbone=biobert-large2023.05 | 78.92 | 81.14 | 76.82 | |
| Li et al. (2020b)reproduction on the same preprocessed dataset=true2022.03 | 78.92 | 81.14 | 76.82 | |
| Yan et al.Encoder=BART-large2022.08 | 78.9 | 78.6 | 79.3 | |
| Ours (8 bits)Backbone=BioBERT, Bits=82024.06 | 78.79 | — | — | |
| Ours (10 bits)Backbone=BioBERT, Bits=102024.06 | 78.72 | — | — | |
| Li et al.Encoder=BERT-large/BioBERT2022.08 | 78.7 | 81.2 | 76.4 | |
| Wang et al. (2021)Encoder=BERT2021.10 | 78.67 | 79.2 | 78.16 | |
| W(max)2022.03 | 78.67 | 79.2 | 78.16 | |
| Wang et al. (2021)Backbone=BioBERT2024.06 | 78.67 | — | — | |
| Ours (6 bits)Backbone=BioBERT, Bits=62024.06 | 78.57 | — | — | |
| CNN_Nested_NER (w.o. CNN)# Param (Million)=111.1, Data Source=Wan et al. (2022), Backbone=BioBERT-base2022.08 | 78.47 | 78.6 | 78.35 | |
| Nested NER as Latent Lexicalized Constituency Parsing2022.03 | 78.44 | 78.39 | 78.5 | |
| Lou et al. (2022)Backbone=BioBERT2024.06 | 78.44 | — | — | |
| Ours (12 bits)Backbone=BioBERT, Bits=122024.06 | 78.4 | — | — | |
| Straková et al. (2019)Category=Generation-based, Backbone=biobert-large2023.05 | 78.31 | — | — | |
| seq2seq+BERT+FlairEmbeddings=BERT+Flair2019.08 | 78.31 | — | — | |
| Straková et al.2021.05 | 78.31 | — | — | |
| Seq2seqEncoder=BERT2021.10 | 78.31 | — | — | |
| Straková et al.2020.05 | 78.3 | — | — | |
| BENSCEncoder=BERT2021.10 | 78.3 | 79.2 | 77.4 | |
| Bottom-up Pointer Networks (w.o. E_yt-1)Encoder=BERT, Eq.1=w.o. E_yt-12021.10 | 78.22 | 78.46 | 77.97 | |
| seq2seq+BERTEmbeddings=BERT2019.08 | 78.2 | — | — | |
| Shibuya and HovyEncoder=BERT2021.10 | 78.2 | 79.92 | 76.55 | |
| Fu et al.Encoder=BERT2021.10 | 78.2 | 78.2 | 78.2 | |
| PO-TreeCRFsdata_preprocessing=different2022.03 | 78.2 | 78.2 | 78.2 | |
| TreeCRFEncoder=BERT2021.10 | 78.2 | 78.2 | 78.2 | |
| Fu et al. (2021)Backbone=BioBERT2024.06 | 78.2 | — | — | |
| Bottom-up Pointer NetworksEncoder=BERT2021.10 | 78.16 | 78.08 | 78.26 | |
| Yang and Tu (2022)2022.03 | 78.16 | 78.08 | 78.26 | |
| Yang and Tu (2022)Backbone=BioBERT2024.06 | 78.16 | — | — | |
| seq2seq+ELMo+BERT+FlairEmbeddings=ELMo+BERT+Flair2019.08 | 78.01 | — | — | |
| LSTM-CRF+BERT+FlairEmbeddings=BERT+Flair2019.08 | 77.91 | — | — | |
| Locate&Labelrerun_on_current_data=true2022.03 | 77.89 | 76.8 | 79.02 | |
| Straková et al. (2019)Category=Tagging-based, Backbone=biobert-large2023.05 | 77.8 | — | — | |
| LSTM-CRF+BERTEmbeddings=BERT2019.08 | 77.8 | — | — |