# Nested Named Entity Recognition on ACE 2004 (test)

Source: [Nested Named Entity Recognition on ACE 2004 (test)](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:43:21.404Z

Evaluation of Nested Named Entity Recognition performance on the test split of the ACE 2004 dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Nested Named Entity Recognition |
| Dataset (including any stated split) | ACE 2004 (test) |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 166 of 166 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [Average F1 Score](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test.md?metric=Average%20F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| BINDER | 89.7 | Not recorded | 68fa6e941e209131cea40d28 |
| BINDER | 88.7 | Not recorded | 68fa6e941e209131cea40d28 |
| Triaffine | 88.56 | Not recorded | 68fa6c331e209131cea32c61 |
| DIFFUSIONNER | 88.39 | Not recorded | 68fa6f661e209131cea45518 |
| DSpERT | 88.31 | Not recorded | 68fa6f411e209131cea448c6 |
| PIQN | 88.14 | Not recorded | 68fa6c141e209131cea32048 |
| Shen et al. (2022) | 88.14 | Not recorded | 68fa6f411e209131cea448c6 |
| DSpERT | 88.05 | Not recorded | 68fa6f411e209131cea448c6 |
| CNN\_Nested\_NER | 88.03 | Not recorded | 68fa6d681e209131cea3995a |
| BS | 87.98 | Not recorded | 68fa6d681e209131cea3995a |
| Zhu and Li (2022) | 87.98 | Not recorded | 68fa6f411e209131cea448c6 |
| Zhu and Li (2022) | 87.98 | Not recorded | 68fa6f661e209131cea45518 |
| Zhu and Li (2022) | 87.98 | Not recorded | 68fa739b1e209131cea5d905 |
| Ours (8 bits) | 87.93 | Not recorded | 68fa739b1e209131cea5d905 |
| Nested NER as Latent Lexicalized Constituency Parsing | 87.9 | Not recorded | 68fa6bf31e209131cea31206 |
| Lou et al. (2022) | 87.9 | Not recorded | 68fa6f661e209131cea45518 |
| Lou et al. (2022) | 87.9 | Not recorded | 68fa739b1e209131cea5d905 |
| Ours (10 bits) | 87.87 | Not recorded | 68fa739b1e209131cea5d905 |
| Pyramid-Full | 87.74 | Not recorded | 68fa6bf31e209131cea31206 |
| Pyramid | 87.74 | Not recorded | 68fa6c331e209131cea32c61 |
| CNN\_Nested\_NER | 87.74 | Not recorded | 68fa6d681e209131cea3995a |
| CNN\_Nested\_NER | 87.61 | Not recorded | 68fa6d681e209131cea3995a |
| PO-TreeCRFs | 87.6 | Not recorded | 68fa6bf31e209131cea31206 |
| W2NER | 87.52 | Not recorded | 68fa6d681e209131cea3995a |
| Li et al. (2022) | 87.52 | Not recorded | 68fa6f411e209131cea448c6 |
| Li et al. (2022a) | 87.52 | Not recorded | 68fa6f661e209131cea45518 |
| Ours (12 bits) | 87.52 | Not recorded | 68fa739b1e209131cea5d905 |
| W2NER | 87.43 | Not recorded | 68fa6d681e209131cea3995a |
| Locate and Label | 87.41 | Not recorded | 68fa6a551e209131cea27793 |
| Shen et al. | 87.41 | Not recorded | 68fa6bf21e209131cea31189 |
| Locate&Label | 87.41 | Not recorded | 68fa6bf31e209131cea31206 |
| Shen et al. (2021a) | 87.41 | Not recorded | 68fa6c141e209131cea32048 |
| Locate and Label | 87.41 | Not recorded | 68fa6c331e209131cea32c61 |
| Shen et al. (2021) | 87.41 | Not recorded | 68fa6f411e209131cea448c6 |
| Shen et al. (2021) | 87.41 | Not recorded | 68fa6f661e209131cea45518 |
| Shen et al. (2021) | 87.41 | Not recorded | 68fa739b1e209131cea5d905 |
| Triaffine | 87.4 | Not recorded | 68fa6c331e209131cea32c61 |
| Yuan et al. (2022b) | 87.4 | Not recorded | 68fa6f661e209131cea45518 |
| Ours (6 bits) | 87.39 | Not recorded | 68fa739b1e209131cea5d905 |
| CNN\_Nested\_NER | 87.31 | Not recorded | 68fa6d681e209131cea3995a |
| Tan et al. | 87.3 | Not recorded | 68fa6e941e209131cea40d28 |
| Tan et al. (2021) | 87.28 | Not recorded | 68fa739b1e209131cea5d905 |
| Tan et al. | 87.26 | Not recorded | 68fa6bf21e209131cea31189 |
| Seq2set | 87.26 | Not recorded | 68fa6bf31e209131cea31206 |
| Tan et al. (2021) | 87.26 | Not recorded | 68fa6c141e209131cea32048 |
| Sequence to Set | 87.26 | Not recorded | 68fa6c331e209131cea32c61 |
| Tan et al. (2021) | 87.26 | Not recorded | 68fa6f661e209131cea45518 |
| BS | 87.08 | Not recorded | 68fa6d681e209131cea3995a |
| CNN\_Nested\_NER (w.o. CNN) | 87.05 | Not recorded | 68fa6d681e209131cea3995a |
| Bottom-up Pointer Networks | 86.94 | Not recorded | 68fa6bf21e209131cea31189 |
| Locate&Label | 86.94 | Not recorded | 68fa6bf31e209131cea31206 |
| Yang and Tu (2022) | 86.94 | Not recorded | 68fa6c141e209131cea32048 |
| Yang and Tu (2022) | 86.94 | Not recorded | 68fa739b1e209131cea5d905 |
| Yan et al. | 86.84 | Not recorded | 68fa6bf21e209131cea31189 |
| BARTNER | 86.84 | Not recorded | 68fa6bf31e209131cea31206 |
| Yan et al. (2021) | 86.84 | Not recorded | 68fa6c141e209131cea32048 |
| BartNER | 86.84 | Not recorded | 68fa6c331e209131cea32c61 |
| Yan et al. (2021) | 86.84 | Not recorded | 68fa6f411e209131cea448c6 |
| Yan et al. (2021b) | 86.84 | Not recorded | 68fa6f661e209131cea45518 |
| CNN\_Nested\_NER (w.o. CNN) | 86.81 | Not recorded | 68fa6d681e209131cea3995a |
| Yan et al. | 86.8 | Not recorded | 68fa6e941e209131cea40d28 |
| Biaffine NER | 86.7 | Not recorded | 68fa67bb1e209131cea182b4 |
| Yu et al. | 86.7 | Not recorded | 68fa6a551e209131cea27793 |
| Yu et al. (2020) | 86.7 | Not recorded | 68fa6c141e209131cea32048 |
| Biaffine | 86.7 | Not recorded | 68fa6c331e209131cea32c61 |
| Yu et al. | 86.7 | Not recorded | 68fa6e941e209131cea40d28 |
| Yu et al. (2020) | 86.7 | Not recorded | 68fa6f411e209131cea448c6 |
| Yu et al. (2020) | 86.7 | Not recorded | 68fa6f661e209131cea45518 |
| Yu et al. (2020) | 86.7 | Not recorded | 68fa739b1e209131cea5d905 |
| Seq2set | 86.65 | Not recorded | 68fa6bf31e209131cea31206 |
| CNN\_Nested\_NER | 86.65 | Not recorded | 68fa6d681e209131cea3995a |
| Fu et al. | 86.6 | Not recorded | 68fa6bf21e209131cea31189 |
| PO-TreeCRFs | 86.6 | Not recorded | 68fa6bf31e209131cea31206 |
| TreeCRF | 86.6 | Not recorded | 68fa6c331e209131cea32c61 |
| Fu et al. (2021) | 86.6 | Not recorded | 68fa739b1e209131cea5d905 |
| CNN\_Nested\_NER (w.o. CNN) | 86.54 | Not recorded | 68fa6d681e209131cea3995a |
| CNN\_Nested\_NER (w.o. CNN) | 86.48 | Not recorded | 68fa6d681e209131cea3995a |
| BoningKnife | 86.41 | Not recorded | 68fa6a5d1e209131cea27bd2 |
| SG | 86.31 | Not recorded | 68fa6d681e209131cea3995a |
| Wan et al. (2022) | 86.31 | Not recorded | 68fa6f661e209131cea45518 |

### BINDER

F1 Score: 89.7. Result ID: 699036c33a6c314849fef591.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Implementation](<https://www.sota2.com/github.com/microsoft/binder>)

Recorded evaluation configuration: {"Encoder":"BERT-large/BioBERT-large"}. This record does not assert independent reproduction.

### BINDER

F1 Score: 88.7. Result ID: 699036c33a6c314849fef590.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Implementation](<https://www.sota2.com/github.com/microsoft/binder>)

Recorded evaluation configuration: {"Encoder":"BERT-base/BioBERT"}. This record does not assert independent reproduction.

### Triaffine

F1 Score: 88.56. Result ID: 698ef3c53a6c314849f3cc73.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Implementation](<https://github.com/GanjinZero/Triaffine-nested-ner>)

Recorded evaluation configuration: {"Encoder":"ALBERT"}. This record does not assert independent reproduction.

### DIFFUSIONNER

F1 Score: 88.39. Result ID: 6990ab873a6c314849024fde.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Implementation](<https://github.com/tricktreat/DiffusionNER>)

Recorded evaluation configuration: {"Category":"Diffusion-based","Backbone":"bert-large","K":60,"T":1000}. This record does not assert independent reproduction.

### DSpERT

F1 Score: 88.31. Result ID: 69909d9f3a6c31484901e349.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"reporting\_metric":"best"}. This record does not assert independent reproduction.

### PIQN

F1 Score: 88.14. Result ID: 698ecb91ffc3901de0a1462e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Implementation](<https://github.com/tricktreat/piqn.>)

Recorded evaluation configuration: {"Backbone":"bert-large"}. This record does not assert independent reproduction.

### Shen et al. (2022)

F1 Score: 88.14. Result ID: 69909d9f3a6c31484901e348.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Implementation](<https://github.com/tricktreat/piqn.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DSpERT

F1 Score: 88.05. Result ID: 69909d9f3a6c31484901e34a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"reporting\_metric":"average"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER

F1 Score: 88.03. Result ID: 698f88f23a6c314849f9c482.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.6M","Data Source":"Zhu and Li (2022)"}. This record does not assert independent reproduction.

### BS

F1 Score: 87.98. Result ID: 698f88f23a6c314849f9c481.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c671e209131cea33df6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.6M","Data Source":"Zhu and Li (2022)"}. This record does not assert independent reproduction.

### Zhu and Li (2022)

F1 Score: 87.98. Result ID: 69909d9f3a6c31484901e347.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c671e209131cea33df6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Zhu and Li (2022)

F1 Score: 87.98. Result ID: 6990ab873a6c314849024fdb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c671e209131cea33df6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Zhu and Li (2022)

F1 Score: 87.98. Result ID: 699305403a6c3148491319df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c671e209131cea33df6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Ours (8 bits)

F1 Score: 87.93. Result ID: 699305403a6c3148491319e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Implementation](<https://github.com/speedcell4/parserker>)

Recorded evaluation configuration: {"Backbone":"BERT","Bits":"8"}. This record does not assert independent reproduction.

### Nested NER as Latent Lexicalized Constituency Parsing

F1 Score: 87.9. Result ID: 698eacf8ffc3901de09fb06d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Implementation](<https://www.sota2.com/github.com/LouChao98/nner_as_parsing>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Lou et al. (2022)

F1 Score: 87.9. Result ID: 6990ab873a6c314849024fda.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Implementation](<https://www.sota2.com/github.com/LouChao98/nner_as_parsing>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Lou et al. (2022)

F1 Score: 87.9. Result ID: 699305403a6c3148491319de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Implementation](<https://www.sota2.com/github.com/LouChao98/nner_as_parsing>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Ours (10 bits)

F1 Score: 87.87. Result ID: 699305403a6c3148491319e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Implementation](<https://github.com/speedcell4/parserker>)

Recorded evaluation configuration: {"Backbone":"BERT","Bits":"10"}. This record does not assert independent reproduction.

### Pyramid-Full

F1 Score: 87.74. Result ID: 698eacf8ffc3901de09fb06e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

Recorded evaluation configuration: {"extra\_features":"+ALBERT"}. This record does not assert independent reproduction.

### Pyramid

F1 Score: 87.74. Result ID: 698ef3c53a6c314849f3cc6b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

Recorded evaluation configuration: {"Encoder":"ALBERT"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER

F1 Score: 87.74. Result ID: 698f88f23a6c314849f9c485.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"345.1M","Data Source":"This Work (New Preprocessing)"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER

F1 Score: 87.61. Result ID: 698f88f23a6c314849f9c47c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"345.1M","Data Source":"Li et al. (2022)"}. This record does not assert independent reproduction.

### PO-TreeCRFs

F1 Score: 87.6. Result ID: 698eacf8ffc3901de09fb069.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f61e209131cea1f5e7.md>)

[Implementation](<https://github.com/FranxYao/Partially-Observed-TreeCRFs>)

Recorded evaluation configuration: {"rerun\_on\_current\_data":true}. This record does not assert independent reproduction.

### W2NER

F1 Score: 87.52. Result ID: 698f88f23a6c314849f9c47b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e9c7.md>)

[Implementation](<https://github.com/ljynlp/W2NER.git>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"355.4M","Data Source":"Li et al. (2022)"}. This record does not assert independent reproduction.

### Li et al. (2022)

F1 Score: 87.52. Result ID: 69909d9f3a6c31484901e346.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e9c7.md>)

[Implementation](<https://github.com/ljynlp/W2NER.git>)

Recorded evaluation configuration: {"reporting\_metric":"average"}. This record does not assert independent reproduction.

### Li et al. (2022a)

F1 Score: 87.52. Result ID: 6990ab873a6c314849024fdd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e9c7.md>)

[Implementation](<https://github.com/ljynlp/W2NER.git>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Ours (12 bits)

F1 Score: 87.52. Result ID: 699305403a6c3148491319e5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Implementation](<https://github.com/speedcell4/parserker>)

Recorded evaluation configuration: {"Backbone":"BERT","Bits":"12"}. This record does not assert independent reproduction.

### W2NER

F1 Score: 87.43. Result ID: 698f88f23a6c314849f9c484.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b7f1e209131cea2e9c7.md>)

[Implementation](<https://github.com/ljynlp/W2NER.git>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"355.4M","Data Source":"This Work (New Preprocessing)","reproduction":true}. This record does not assert independent reproduction.

### Locate and Label

F1 Score: 87.41. Result ID: 698e2b05ffc3901de09b5781.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Backbone":"BERT + GloVe"}. This record does not assert independent reproduction.

### Shen et al.

F1 Score: 87.41. Result ID: 698eabc9ffc3901de09fa8ad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Locate&Label

F1 Score: 87.41. Result ID: 698eacf8ffc3901de09fb071.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"context\_sentences":true,"pos\_tags":true,"data\_preprocessing":"different"}. This record does not assert independent reproduction.

### Shen et al. (2021a)

F1 Score: 87.41. Result ID: 698ecb91ffc3901de0a1462d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Locate and Label

F1 Score: 87.41. Result ID: 698ef3c53a6c314849f3cc71.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Shen et al. (2021)

F1 Score: 87.41. Result ID: 69909d9f3a6c31484901e345.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Shen et al. (2021)

F1 Score: 87.41. Result ID: 6990ab873a6c314849024fd8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Shen et al. (2021)

F1 Score: 87.41. Result ID: 699305403a6c3148491319dc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Triaffine

F1 Score: 87.4. Result ID: 698ef3c53a6c314849f3cc72.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Implementation](<https://github.com/GanjinZero/Triaffine-nested-ner>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Yuan et al. (2022b)

F1 Score: 87.4. Result ID: 6990ab873a6c314849024fdc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Implementation](<https://github.com/GanjinZero/Triaffine-nested-ner>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Ours (6 bits)

F1 Score: 87.39. Result ID: 699305403a6c3148491319e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Implementation](<https://github.com/speedcell4/parserker>)

Recorded evaluation configuration: {"Backbone":"BERT","Bits":"6"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER

F1 Score: 87.31. Result ID: 698f88f23a6c314849f9c488.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.6M","Data Source":"This Work (New Preprocessing)"}. This record does not assert independent reproduction.

### Tan et al.

F1 Score: 87.3. Result ID: 699036c33a6c314849fef58c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Encoder":"BERT-large/BioBERT"}. This record does not assert independent reproduction.

### Tan et al. (2021)

F1 Score: 87.28. Result ID: 699305403a6c3148491319dd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Tan et al.

F1 Score: 87.26. Result ID: 698eabc9ffc3901de09fa8ae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Seq2set

F1 Score: 87.26. Result ID: 698eacf8ffc3901de09fb070.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"context\_sentences":true,"pos\_tags":true,"data\_preprocessing":"different"}. This record does not assert independent reproduction.

### Tan et al. (2021)

F1 Score: 87.26. Result ID: 698ecb91ffc3901de0a1462c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Sequence to Set

F1 Score: 87.26. Result ID: 698ef3c53a6c314849f3cc70.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Tan et al. (2021)

F1 Score: 87.26. Result ID: 6990ab873a6c314849024fd5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Category":"Generation-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### BS

F1 Score: 87.08. Result ID: 698f88f23a6c314849f9c487.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c671e209131cea33df6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.6M","Data Source":"This Work (New Preprocessing)","reproduction":true}. This record does not assert independent reproduction.

### CNN\_Nested\_NER (w.o. CNN)

F1 Score: 87.05. Result ID: 698f88f23a6c314849f9c483.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.2M","Data Source":"Zhu and Li (2022)"}. This record does not assert independent reproduction.

### Bottom-up Pointer Networks

F1 Score: 86.94. Result ID: 698eabc9ffc3901de09fa8af.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Implementation](<https://github.com/sustcsonglin/pointer-net-for-nested>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Locate&Label

F1 Score: 86.94. Result ID: 698eacf8ffc3901de09fb06b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"rerun\_on\_current\_data":true}. This record does not assert independent reproduction.

### Yang and Tu (2022)

F1 Score: 86.94. Result ID: 698ecb91ffc3901de0a1462b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Implementation](<https://github.com/sustcsonglin/pointer-net-for-nested>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yang and Tu (2022)

F1 Score: 86.94. Result ID: 699305403a6c3148491319e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Implementation](<https://github.com/sustcsonglin/pointer-net-for-nested>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Yan et al.

F1 Score: 86.84. Result ID: 698eabc9ffc3901de09fa8ac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### BARTNER

F1 Score: 86.84. Result ID: 698eacf8ffc3901de09fb06c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yan et al. (2021)

F1 Score: 86.84. Result ID: 698ecb91ffc3901de0a1462a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BartNER

F1 Score: 86.84. Result ID: 698ef3c53a6c314849f3cc6f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: {"Encoder":"BART"}. This record does not assert independent reproduction.

### Yan et al. (2021)

F1 Score: 86.84. Result ID: 69909d9f3a6c31484901e344.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yan et al. (2021b)

F1 Score: 86.84. Result ID: 6990ab873a6c314849024fd4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: {"Category":"Generation-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER (w.o. CNN)

F1 Score: 86.81. Result ID: 698f88f23a6c314849f9c47d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"343.6M","Data Source":"Li et al. (2022)"}. This record does not assert independent reproduction.

### Yan et al.

F1 Score: 86.8. Result ID: 699036c33a6c314849fef58d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0a1e209131cea25ac7.md>)

[Implementation](<https://github.com/yhcc/BARTNER>)

Recorded evaluation configuration: {"Encoder":"BART-large"}. This record does not assert independent reproduction.

### Biaffine NER

F1 Score: 86.7. Result ID: 698d43758b517eb433203202.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yu et al.

F1 Score: 86.7. Result ID: 698e2b05ffc3901de09b5780.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yu et al. (2020)

F1 Score: 86.7. Result ID: 698ecb91ffc3901de0a14629.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Biaffine

F1 Score: 86.7. Result ID: 698ef3c53a6c314849f3cc69.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Yu et al.

F1 Score: 86.7. Result ID: 699036c33a6c314849fef58b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e941e209131cea40d28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: {"Encoder":"BERT-large/BioBERT"}. This record does not assert independent reproduction.

### Yu et al. (2020)

F1 Score: 86.7. Result ID: 69909d9f3a6c31484901e343.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yu et al. (2020)

F1 Score: 86.7. Result ID: 6990ab873a6c314849024fd6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

### Yu et al. (2020)

F1 Score: 86.7. Result ID: 699305403a6c3148491319db.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67bb1e209131cea182b4.md>)

[Implementation](<https://github.com/juntaoy/biaffine-ner>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### Seq2set

F1 Score: 86.65. Result ID: 698eacf8ffc3901de09fb06a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"rerun\_on\_current\_data":true}. This record does not assert independent reproduction.

### CNN\_Nested\_NER

F1 Score: 86.65. Result ID: 698f88f23a6c314849f9c47f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"BERT-base","Parameters":"110.5M","Data Source":"Wan et al. (2022)"}. This record does not assert independent reproduction.

### Fu et al.

F1 Score: 86.6. Result ID: 698eabc9ffc3901de09fa8aa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf21e209131cea31189.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f61e209131cea1f5e7.md>)

[Implementation](<https://github.com/FranxYao/Partially-Observed-TreeCRFs>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### PO-TreeCRFs

F1 Score: 86.6. Result ID: 698eacf8ffc3901de09fb06f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6bf31e209131cea31206.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f61e209131cea1f5e7.md>)

[Implementation](<https://github.com/FranxYao/Partially-Observed-TreeCRFs>)

Recorded evaluation configuration: {"data\_preprocessing":"different"}. This record does not assert independent reproduction.

### TreeCRF

F1 Score: 86.6. Result ID: 698ef3c53a6c314849f3cc68.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f61e209131cea1f5e7.md>)

[Implementation](<https://github.com/FranxYao/Partially-Observed-TreeCRFs>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Fu et al. (2021)

F1 Score: 86.6. Result ID: 699305403a6c3148491319da.

[Reporting paper](<https://www.sota2.com/research/paper/68fa739b1e209131cea5d905.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68f61e209131cea1f5e7.md>)

[Implementation](<https://github.com/FranxYao/Partially-Observed-TreeCRFs>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER (w.o. CNN)

F1 Score: 86.54. Result ID: 698f88f23a6c314849f9c486.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"BERT-large","Parameters":"343.6M","Data Source":"This Work (New Preprocessing)"}. This record does not assert independent reproduction.

### CNN\_Nested\_NER (w.o. CNN)

F1 Score: 86.48. Result ID: 698f88f23a6c314849f9c489.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

[Implementation](<https://github.com/yhcc/CNN_Nested_NER>)

Recorded evaluation configuration: {"Backbone":"ROBERTa-base","Parameters":"125.2M","Data Source":"This Work (New Preprocessing)"}. This record does not assert independent reproduction.

### BoningKnife

F1 Score: 86.41. Result ID: 698e2f10ffc3901de09b788b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a5d1e209131cea27bd2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a5d1e209131cea27bd2.md>)

Recorded evaluation configuration: {"Pre-trained model":"BERT-base"}. This record does not assert independent reproduction.

### SG

F1 Score: 86.31. Result ID: 698f88f23a6c314849f9c47e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6d681e209131cea3995a.md>)

Recorded evaluation configuration: {"Backbone":"BERT-base","Parameters":"112.3M","Data Source":"Wan et al. (2022)"}. This record does not assert independent reproduction.

### Wan et al. (2022)

F1 Score: 86.31. Result ID: 6990ab873a6c314849024fd9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f661e209131cea45518.md>)

Recorded evaluation configuration: {"Category":"Span-based","Backbone":"bert-large"}. This record does not assert independent reproduction.

Page 1 of 3. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-ace-2004-test.md?metric=F1%20Score&page=2>): Follow this link to discover more pages.
