Nested Named Entity Recognition on ACE 2004
86.84F1 Score (%)BARTNER (Word)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BARTNER (Word)Backbone=BART-Large, Entity Representation=Word2021.06 | 86.84 | 87.27 | 86.41 | |
| Yu, Bohnet, and PoesioAdditional Supervision=true2020.12 | 86.7 | 87.3 | 86 | |
| PO-TreeCRFsEncoder=BERT2020.12 | 86.6 | 86.7 | 86.5 | |
| PO-TreeCRFsEncoder=BERT, Ablation=Change Biaffine to Bilinear2020.12 | 86.4 | 86 | 86.7 | |
| PyramidEncoder=BERT2020.12 | 86.3 | 86.1 | 86.5 | |
| Wang et al. (2020a)Backbone=BERT-Large, Configuration=Fair comparison2021.06 | 86.28 | 86.08 | 86.48 | |
| PO-TreeCRFsEncoder=BERT, Ablation=W/o. Structure Smoothing2020.12 | 86.2 | 86.1 | 86.4 | |
| BERT-MRCAdditional Supervision=true2020.12 | 86 | 85 | 86.3 | |
| BERT-MRC2019.10 | 85.98 | 85.05 | 86.32 | |
| Li et al. (2020b)Backbone=BERT-Large, Reproduction=Rerun code2021.06 | 85.8 | 85.83 | 85.77 | |
| PO-TreeCRFsEncoder=BERT, Ablation=W/o. Potential Normalization and Structure Smoothing2020.12 | 85.7 | 86 | 85.3 | |
| Yu et al. (2020)Backbone=BERT-Large, Reproduction=Sentence-level context only2021.06 | 85.67 | 85.42 | 85.92 | |
| BENSCEncoder=BERT2020.12 | 85.3 | 85.8 | 84.8 | |
| BARTNER (BPE)Backbone=BART-Large, Entity Representation=BPE2021.06 | 85.24 | 86.69 | 83.83 | |
| Shibuya and Hovy (2020)Backbone=BERT-Large, Reproduction=Rerun code2021.06 | 84.97 | 85.23 | 84.72 | |
| PO-TreeCRFsEncoder=BERT, Ablation=W/o. TreeCRFs2020.12 | 84.9 | 84.4 | 85.4 | |
| DYGIEAdditional Supervision=true2020.12 | 84.7 | — | — | |
| Luan et al. (2019)Backbone=ELMo2021.06 | 84.7 | — | — | |
| DYGIE2019.10 | 84.7 | — | — | |
| Seq2seq-BERT2019.10 | 84.4 | — | — | |
| Straková et al. (2019)Backbone=BERT-Large2021.06 | 84.33 | — | — | |
| BARTNER (Span)Backbone=BART-Large, Entity Representation=Span2021.06 | 84.22 | 84.81 | 83.64 | |
| Path-BERT2019.10 | 82.81 | 83.73 | 81.91 | |
| PyramidEncoder=None2020.12 | 80.3 | 81.1 | 79.4 | |
| MGNEREncoder=ELMo2020.12 | 79.5 | 81.7 | 77.4 | |
| BENSCEncoder=None2020.12 | 75.3 | 78.1 | 72.8 | |
| Seg-Graph2019.10 | 75.1 | 78 | 72.4 | |
| SHEncoder=None, c=n2020.12 | 74.5 | 77.7 | 72.1 | |
| TransitionEncoder=None2020.12 | 73.3 | 74.9 | 71.8 | |
| Hyper-Graph2019.10 | 72.7 | 73.6 | 71.8 | |
| FOFEEncoder=None, c=62020.12 | 60.5 | 68.2 | 54.3 | |
| LSTM-CRFEncoder=None2020.12 | 58.3 | 71.3 | 50.5 |