Named Entity Recognition on Ontonotes 5.0 (50 instances) (test)
69.98F1 Scoreentity-oriented demonstration
Evaluation results
| Method | Links | |
|---|---|---|
| entity-oriented demonstrationStrategy=search, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.98 | |
| entity-oriented demonstrationStrategy=popular, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.91 | |
| entity-oriented demonstrationStrategy=search, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.57 | |
| entity-oriented demonstrationStrategy=popular, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.39 | |
| entity-oriented demonstrationStrategy=popular, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.34 | |
| entity-oriented demonstrationStrategy=random, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.32 | |
| entity-oriented demonstrationStrategy=random, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 69.26 | |
| entity-oriented demonstrationStrategy=search, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 68.93 | |
| entity-oriented demonstrationStrategy=random, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 68.84 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 68.68 | |
| instance-oriented demonstrationStrategy=SBERT, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 68.52 | |
| instance-oriented demonstrationStrategy=SBERT, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 67.86 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 67.46 | |
| BERT+CRF w/o demonstrationBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 66.44 | |
| NNShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 46.34 | |
| StructShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Sharing2021.10 | 43.02 |