# Nested Named Entity Recognition on KBP English 2017 (test)

Source: [Nested Named Entity Recognition on KBP English 2017 (test)](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-kbp-english-2017-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:58:23.332Z

Evaluation of Nested Named Entity Recognition performance on the test split of the KBP English 2017 dataset, typically measured using Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Nested Named Entity Recognition |
| Dataset (including any stated split) | KBP English 2017 (test) |
| Metric | Precision |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Precision](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-kbp-english-2017-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-kbp-english-2017-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/nested-named-entity-recognition-on-kbp-english-2017-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Precision | Result date | Report paper |
| --- | --- | --- | --- |
| Triaffine | 89.42 | Not recorded | 68fa6c331e209131cea32c61 |
| DSpERT | 87.37 | Not recorded | 68fa6f411e209131cea448c6 |
| DSpERT | 87 | Not recorded | 68fa6f411e209131cea448c6 |
| Triaffine | 86.5 | Not recorded | 68fa6c331e209131cea32c61 |
| PIQN | 85.67 | Not recorded | 68fa6c141e209131cea32048 |
| Shen et al. (2022) | 85.67 | Not recorded | 68fa6f411e209131cea448c6 |
| Locate and Label | 85.46 | Not recorded | 68fa6a551e209131cea27793 |
| Shen et al. (2021a) | 85.46 | Not recorded | 68fa6c141e209131cea32048 |
| Locate and Label | 85.46 | Not recorded | 68fa6c331e209131cea32c61 |
| Shen et al. (2021) | 85.46 | Not recorded | 68fa6f411e209131cea448c6 |
| Sequence-to-Set Network | 84.91 | Not recorded | 68fa6a3d1e209131cea26e3c |
| Tan et al. (2021) | 84.91 | Not recorded | 68fa6c141e209131cea32048 |
| Sequence to Set | 84.91 | Not recorded | 68fa6c331e209131cea32c61 |
| Li et al. (2020b) | 82.33 | Not recorded | 68fa6f411e209131cea448c6 |
| Li et al. | 80.97 | Not recorded | 68fa6a3d1e209131cea26e3c |
| Li et al. | 80.97 | Not recorded | 68fa6a551e209131cea27793 |
| Li et al. (2020b) | 80.97 | Not recorded | 68fa6c141e209131cea32048 |
| Lin et al. | 77.7 | Not recorded | 68fa6a3d1e209131cea26e3c |
| Lin et al. | 77.7 | Not recorded | 68fa6a551e209131cea27793 |
| Lin et al. (2019) | 77.7 | Not recorded | 68fa6c141e209131cea32048 |
| ARN | 77.7 | Not recorded | 68fa6c331e209131cea32c61 |
| Luo and Zhao | 77.1 | Not recorded | 68fa6a3d1e209131cea26e3c |
| Luo and Zhao | 77.1 | Not recorded | 68fa6a551e209131cea27793 |
| Luo and Zhao (2020) | 77.1 | Not recorded | 68fa6c141e209131cea32048 |
| BiFlag | 77.1 | Not recorded | 68fa6c331e209131cea32c61 |
| Ji et al. | 76.2 | Not recorded | 68fa6a3d1e209131cea26e3c |
| Ji et al. | 76.2 | Not recorded | 68fa6a551e209131cea27793 |
| Ji et al. (2017) | 76.2 | Not recorded | 68fa6c141e209131cea32048 |

### Triaffine

Precision: 89.42. Result ID: 698ef3c53a6c314849f3cc64.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Implementation](<https://github.com/GanjinZero/Triaffine-nested-ner>)

Recorded evaluation configuration: {"Encoder":"ALBERT"}. This record does not assert independent reproduction.

### DSpERT

Precision: 87.37. Result ID: 69909d9f3a6c31484901e35e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"reporting\_metric":"best"}. This record does not assert independent reproduction.

### DSpERT

Precision: 87. Result ID: 69909d9f3a6c31484901e35f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Implementation](<https://github.com/syuoni/eznlp>)

Recorded evaluation configuration: {"reporting\_metric":"average"}. This record does not assert independent reproduction.

### Triaffine

Precision: 86.5. Result ID: 698ef3c53a6c314849f3cc63.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Implementation](<https://github.com/GanjinZero/Triaffine-nested-ner>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### PIQN

Precision: 85.67. Result ID: 698ecb91ffc3901de0a1464b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Implementation](<https://github.com/tricktreat/piqn.>)

Recorded evaluation configuration: {"Backbone":"bert-base"}. This record does not assert independent reproduction.

### Shen et al. (2022)

Precision: 85.67. Result ID: 69909d9f3a6c31484901e35d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Implementation](<https://github.com/tricktreat/piqn.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Locate and Label

Precision: 85.46. Result ID: 698e2b05ffc3901de09b578d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Backbone":"BERT + GloVe"}. This record does not assert independent reproduction.

### Shen et al. (2021a)

Precision: 85.46. Result ID: 698ecb91ffc3901de0a1464a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Locate and Label

Precision: 85.46. Result ID: 698ef3c53a6c314849f3cc62.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Shen et al. (2021)

Precision: 85.46. Result ID: 69909d9f3a6c31484901e35c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Implementation](<https://github.com/tricktreat/locate-and-label.>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Sequence-to-Set Network

Precision: 84.91. Result ID: 698e2183ffc3901de09b07a1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"backbone":"BERT-Large"}. This record does not assert independent reproduction.

### Tan et al. (2021)

Precision: 84.91. Result ID: 698ecb91ffc3901de0a14649.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Sequence to Set

Precision: 84.91. Result ID: 698ef3c53a6c314849f3cc61.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Implementation](<https://github.com/zqtan1024/sequence-to-set>)

Recorded evaluation configuration: {"Encoder":"BERT"}. This record does not assert independent reproduction.

### Li et al. (2020b)

Precision: 82.33. Result ID: 69909d9f3a6c31484901e35b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f411e209131cea448c6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfa1e209131cea3d1ea.md>)

[Implementation](<https://github.com/ShannonAI/mrc-for-flat-nested-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Li et al.

Precision: 80.97. Result ID: 698e2183ffc3901de09b07a0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfa1e209131cea3d1ea.md>)

[Implementation](<https://github.com/ShannonAI/mrc-for-flat-nested-ner>)

Recorded evaluation configuration: {"year":"2020"}. This record does not assert independent reproduction.

### Li et al.

Precision: 80.97. Result ID: 698e2b05ffc3901de09b578c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfa1e209131cea3d1ea.md>)

[Implementation](<https://github.com/ShannonAI/mrc-for-flat-nested-ner>)

Recorded evaluation configuration: {"suffix":"2020b"}. This record does not assert independent reproduction.

### Li et al. (2020b)

Precision: 80.97. Result ID: 698ecb91ffc3901de0a14648.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dfa1e209131cea3d1ea.md>)

[Implementation](<https://github.com/ShannonAI/mrc-for-flat-nested-ner>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Lin et al.

Precision: 77.7. Result ID: 698e2183ffc3901de09b079e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d14f.md>)

[Implementation](<https://www.sota2.com/github.com/sanmusunrise/ARNs>)

Recorded evaluation configuration: {"year":"2019"}. This record does not assert independent reproduction.

### Lin et al.

Precision: 77.7. Result ID: 698e2b05ffc3901de09b578a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d14f.md>)

[Implementation](<https://www.sota2.com/github.com/sanmusunrise/ARNs>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Lin et al. (2019)

Precision: 77.7. Result ID: 698ecb91ffc3901de0a14646.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d14f.md>)

[Implementation](<https://www.sota2.com/github.com/sanmusunrise/ARNs>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ARN

Precision: 77.7. Result ID: 698ef3c53a6c314849f3cc5f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d14f.md>)

[Implementation](<https://www.sota2.com/github.com/sanmusunrise/ARNs>)

Recorded evaluation configuration: {"Encoder":"LSTM"}. This record does not assert independent reproduction.

### Luo and Zhao

Precision: 77.1. Result ID: 698e2183ffc3901de09b079f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67771e209131cea1680f.md>)

[Implementation](<https://github.com/cslydia/BiFlaG>)

Recorded evaluation configuration: {"year":"2020"}. This record does not assert independent reproduction.

### Luo and Zhao

Precision: 77.1. Result ID: 698e2b05ffc3901de09b578b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67771e209131cea1680f.md>)

[Implementation](<https://github.com/cslydia/BiFlaG>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Luo and Zhao (2020)

Precision: 77.1. Result ID: 698ecb91ffc3901de0a14647.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67771e209131cea1680f.md>)

[Implementation](<https://github.com/cslydia/BiFlaG>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BiFlag

Precision: 77.1. Result ID: 698ef3c53a6c314849f3cc60.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c331e209131cea32c61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67771e209131cea1680f.md>)

[Implementation](<https://github.com/cslydia/BiFlaG>)

Recorded evaluation configuration: {"Encoder":"LSTM"}. This record does not assert independent reproduction.

### Ji et al.

Precision: 76.2. Result ID: 698e2183ffc3901de09b079d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a3d1e209131cea26e3c.md>)

Recorded evaluation configuration: {"year":"2017"}. This record does not assert independent reproduction.

### Ji et al.

Precision: 76.2. Result ID: 698e2b05ffc3901de09b5789.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a551e209131cea27793.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Ji et al. (2017)

Precision: 76.2. Result ID: 698ecb91ffc3901de0a14645.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c141e209131cea32048.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.