Named Entity Recognition on FewNERD INTRA
67.94F1 ScoreTadNER
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TadNERParadigm=Two-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 67.94 | — | — | — | — | — | — | — | — | |
| DecomposedMetaNERParadigm=Two-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 62.92 | — | — | — | — | — | — | — | — | |
| TadNERParadigm=Two-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 60.87 | — | — | — | — | — | — | — | — | |
| TadNERParadigm=Two-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 60.78 | — | — | — | — | — | — | — | — | |
| CONTaiNERParadigm=One-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 57.83 | — | — | — | — | — | — | — | — | |
| DecomposedMetaNERParadigm=Two-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 57.31 | — | — | — | — | — | — | — | — | |
| TadNERParadigm=Two-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 55.44 | — | — | — | — | — | — | — | — | |
| ESDParadigm=Two-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 52.14 | — | — | — | — | — | — | — | — | |
| CONTaiNERParadigm=One-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 51.04 | — | — | — | — | — | — | — | — | |
| HyperProtoSetting=5 way 5~10 shot, Encoder=BERT2022.11 | 50.88 | — | — | — | — | — | 48.77 | 53.26 | — | |
| DecomposedMetaNERParadigm=Two-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 49.48 | — | — | — | — | — | — | — | — | |
| FSLSParadigm=One-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 46.85 | — | — | — | — | — | — | — | — | |
| DecomposedMetaNERParadigm=Two-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 42.84 | — | — | — | — | — | — | — | — | |
| ProtoBERTParadigm=One-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 42.54 | — | — | — | — | — | — | — | — | |
| HyperProtoSetting=10 way 5~10 shot, Encoder=BERT2022.11 | 42.46 | — | — | — | — | — | 38.94 | 46.71 | — | |
| ESDParadigm=Two-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 42.15 | — | — | — | — | — | — | — | — | |
| ProtoNetSetting=5 way 5~10 shot, Encoder=BERT2022.11 | 41.93 | — | — | — | — | — | 35.87 | 50.5 | — | |
| CONTaiNERParadigm=One-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 41.51 | — | — | — | — | — | — | — | — | |
| FSLSParadigm=One-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 40.76 | — | — | — | — | — | — | — | — | |
| StructShotParadigm=One-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 38 | — | — | — | — | — | — | — | — | |
| HyperProtoSetting=Average, Encoder=BERT2022.11 | 37.41 | — | — | — | — | — | — | — | — | |
| CONTaiNERParadigm=One-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 36.62 | — | — | — | — | — | — | — | — | |
| NNShotParadigm=One-stage, N-way=5-way, Shot Range=5~10-shot2023.02 | 36.18 | — | — | — | — | — | — | — | — | |
| ESDParadigm=Two-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 36.08 | — | — | — | — | — | — | — | — | |
| NNShotSetting=5 way 5~10 shot, Encoder=BERT2022.11 | 35.74 | — | — | — | — | — | 32.87 | 39.17 | — | |
| ProtoBERTParadigm=One-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 35.4 | — | — | — | — | — | — | — | — | |
| ProtoNetSetting=10 way 5~10 shot, Encoder=BERT2022.11 | 34.61 | — | — | — | — | — | 28.93 | 43.08 | — | |
| HyperProtoSetting=5 way 1~2 shot, Encoder=BERT2022.11 | 32.26 | — | — | — | — | — | 40.18 | 26.96 | — | |
| NNShotSetting=5 way 1~2 shot, Encoder=BERT2022.11 | 31.01 | — | — | — | — | — | 28.95 | 33.4 | — | |
| FSLSParadigm=One-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 30.38 | — | — | — | — | — | — | — | — | |
| StructShotParadigm=One-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 30.21 | — | — | — | — | — | — | — | — | |
| ESDParadigm=Two-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 30 | — | — | — | — | — | — | — | — | |
| ProtoNetSetting=Average, Encoder=BERT2022.11 | 29.94 | — | — | — | — | — | — | — | — | |
| NNShotSetting=Average, Encoder=BERT2022.11 | 29.08 | — | — | — | — | — | — | — | — | |
| FSLSParadigm=One-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 28.31 | — | — | — | — | — | — | — | — | |
| NNShotSetting=10 way 5~10 shot, Encoder=BERT2022.11 | 27.67 | — | — | — | — | — | 25.46 | 30.32 | — | |
| NNShotParadigm=One-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 27.38 | — | — | — | — | — | — | — | — | |
| StructShotParadigm=One-stage, N-way=10-way, Shot Range=5~10-shot2023.02 | 26.42 | — | — | — | — | — | — | — | — | |
| NNShotParadigm=One-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 25.78 | — | — | — | — | — | — | — | — | |
| HyperProtoSetting=10 way 1~2 shot, Encoder=BERT2022.11 | 24.02 | — | — | — | — | — | 26.06 | 22.32 | — | |
| ProtoNetSetting=5 way 1~2 shot, Encoder=BERT2022.11 | 23.45 | — | — | — | — | — | 18.58 | 31.83 | — | |
| NNShotSetting=10 way 1~2 shot, Encoder=BERT2022.11 | 21.88 | — | — | — | — | — | 20.38 | 23.63 | — | |
| StructShotParadigm=One-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 21.03 | — | — | — | — | — | — | — | — | |
| ProtoBERTParadigm=One-stage, N-way=5-way, Shot Range=1~2-shot2023.02 | 20.76 | — | — | — | — | — | — | — | — | |
| ProtoNetSetting=10 way 1~2 shot, Encoder=BERT2022.11 | 19.76 | — | — | — | — | — | 16.52 | 24.6 | — | |
| NNShotParadigm=One-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 18.27 | — | — | — | — | — | — | — | — | |
| ProtoBERTParadigm=One-stage, N-way=10-way, Shot Range=1~2-shot2023.02 | 15.05 | — | — | — | — | — | — | — | — | |
| CONTaiNERParadigm=One-stage2023.02 | — | — | — | — | — | 46.75 | — | — | — | |
| CONTAINERk=52023.05 | — | — | — | — | — | — | — | — | 47.51 | |
| CONTaiNER-Viterbi + BERTSetting=INTRA, Backbone=BERT2022.10 | — | 40.4 | 33.82 | 53.71 | 47.51 | 43.86 | — | — | — | |
| CONTaiNER-Viterbi + BERT-SparseLTSetting=INTRA, Backbone=BERT-SparseLT2022.10 | — | 47.2 | 40.48 | 59.67 | 53.04 | 50.1 | — | — | — | |
| DecomposedMetaNERParadigm=Two-stage2023.02 | — | — | — | — | — | 53.14 | — | — | — | |
| ESDEncoder=uncased BERT-base2021.09 | — | 36.08 | 30 | 52.14 | 42.15 | 40.09 | — | — | — | |
| ESDParadigm=Two-stage2023.02 | — | — | — | — | — | 40.09 | — | — | — | |
| FSLSParadigm=One-stage2023.02 | — | — | — | — | — | 36.58 | — | — | — | |
| Meta Learningk=52023.05 | — | — | — | — | — | — | — | — | 56.8 | |
| NNShotEncoder=uncased BERT-base2021.09 | — | 25.78 | 18.27 | 36.18 | 27.38 | 26.9 | — | — | — | |
| NNShotParadigm=One-stage2023.02 | — | — | — | — | — | 26.9 | — | — | — | |
| NuNER-BERTBackbone=NuNER-BERT2024.02 | — | 62.48 | 57.63 | 69.16 | 62.99 | 63.07 | — | — | — | |
| ProMLk=52023.05 | — | — | — | — | — | — | — | — | 68.1 | |
| PromptNER GPT 4k=22023.05 | — | — | — | — | — | — | — | — | 72.63 | |
| PromptNER GPT3.5k=22023.05 | — | — | — | — | — | — | — | — | 62.33 | |
| PromptNER T5XXLk=22023.05 | — | — | — | — | — | — | — | — | 55.7 | |
| ProtoBERTEncoder=uncased BERT-base2021.09 | — | 20.76 | 15.04 | 42.54 | 35.4 | 28.44 | — | — | — | |
| ProtoBERTParadigm=One-stage2023.02 | — | — | — | — | — | 28.44 | — | — | — | |
| StructShotEncoder=uncased BERT-base2021.09 | — | 30.21 | 21.03 | 38 | 26.42 | 28.92 | — | — | — | |
| StructShotSetting=INTRA2022.10 | — | 30.21 | 21.03 | 38 | 26.42 | 28.92 | — | — | — | |
| StructShotParadigm=One-stage2023.02 | — | — | — | — | — | 28.92 | — | — | — | |
| TadNERParadigm=Two-stage2023.02 | — | — | — | — | — | 61.26 | — | — | — | |
| TadNERBackbone=Original2024.02 | — | 60.78 | 55.44 | 67.94 | 60.87 | 61.26 | — | — | — |