Named Entity Recognition on OntoNotes to I2B2, CoNLL, WNUT, GUM 5.0 (test)
45.2I2B2 ScoreTadNER
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TadNERParadigm=Two-stage2023.02 | 45.2 | 80.5 | 34.5 | 35.1 | 48.8 | |
| TadNERParadigm=Two-stage2023.02 | 39.3 | 70.4 | 32.8 | 24.2 | 41.7 | |
| CONTAINER + ViterbiShots=5-shot, Backbone=bert-base-cased2021.09 | 36.7 | 75.8 | 32.5 | 25.2 | 42.6 | |
| CONTaiNERParadigm=One-stage2023.02 | 36.7 | 75.8 | 32.5 | 25.2 | 42.6 | |
| StructShotShots=5-shot, Backbone=bert-base-cased2021.09 | 30.3 | 74.8 | 30.4 | 13.3 | 37.2 | |
| StructShotParadigm=One-stage2023.02 | 30.3 | 74.8 | 30.4 | 13.3 | 37.2 | |
| FSLSParadigm=One-stage, Replicated=true2023.02 | 25.4 | 63.9 | 24 | 18.8 | 33.1 | |
| CONTAINERShots=5-shot, Backbone=bert-base-cased2021.09 | 24.1 | 72.8 | 27.7 | 24.4 | 37.3 | |
| NNShotShots=5-shot, Backbone=bert-base-cased2021.09 | 22 | 74.1 | 27.3 | 15.9 | 34.8 | |
| NNShotParadigm=One-stage2023.02 | 22 | 74.1 | 27.3 | 15.9 | 34.8 | |
| CONTAINER + ViterbiShots=1-shot, Backbone=bert-base-cased2021.09 | 21.5 | 61.2 | 27.5 | 18.5 | 32.2 | |
| CONTaiNERParadigm=One-stage2023.02 | 21.5 | 61.2 | 27.5 | 18.5 | 32.2 | |
| StructShotShots=1-shot, Backbone=bert-base-cased2021.09 | 21.4 | 62.4 | 24.2 | 7.8 | 29 | |
| StructShotParadigm=One-stage2023.02 | 21.4 | 62.4 | 24.2 | 7.8 | 29 | |
| DecomposedMetaNERParadigm=Two-stage, Replicated=true2023.02 | 19.8 | 75.2 | 29.8 | 33.5 | 39.6 | |
| FSLSParadigm=One-stage, Replicated=true2023.02 | 18.3 | 50.9 | 14.3 | 12.6 | 24 | |
| ProtoShots=5-shot, Backbone=bert-base-cased2021.09 | 17.9 | 61.3 | 22.8 | 19.5 | 30.4 | |
| ProtoBERTParadigm=One-stage2023.02 | 17.9 | 61.3 | 22.8 | 19.5 | 30.4 | |
| TadNERprotocol=zero-shot2023.02 | 17.13 | 43.14 | 25.06 | 7.62 | 23.24 | |
| CONTAINERShots=1-shot, Backbone=bert-base-cased2021.09 | 16.4 | 57.8 | 24.2 | 17.9 | 29.1 | |
| DecomposedMetaNERParadigm=Two-stage, Replicated=true2023.02 | 15.5 | 61.2 | 27.7 | 20.3 | 31.2 | |
| NNShotShots=1-shot, Backbone=bert-base-cased2021.09 | 15.3 | 61.2 | 22.7 | 10.5 | 27.4 | |
| NNShotParadigm=One-stage2023.02 | 15.3 | 61.2 | 22.7 | 10.5 | 27.4 | |
| ProtoShots=1-shot, Backbone=bert-base-cased2021.09 | 13.4 | 49.9 | 17.4 | 17.8 | 24.6 | |
| ProtoBERTParadigm=One-stage2023.02 | 13.4 | 49.9 | 17.4 | 17.8 | 24.6 | |
| SpanNERprotocol=zero-shot2023.02 | 8.02 | 23.63 | 24.82 | 6.57 | 15.76 |