Named Entity Recognition on BC5CDR 25 instances (test)
54.97F1 Scoreentity-oriented demonstration
Evaluation results
| Method | Links | |
|---|---|---|
| entity-oriented demonstrationStrategy=search, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.97 | |
| entity-oriented demonstrationStrategy=search, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.7 | |
| entity-oriented demonstrationStrategy=search, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.51 | |
| entity-oriented demonstrationStrategy=popular, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.45 | |
| entity-oriented demonstrationStrategy=popular, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.33 | |
| entity-oriented demonstrationStrategy=popular, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.3 | |
| entity-oriented demonstrationStrategy=random, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 54.05 | |
| entity-oriented demonstrationStrategy=random, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 53.85 | |
| entity-oriented demonstrationStrategy=random, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 53.61 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 53.58 | |
| instance-oriented demonstrationStrategy=SBERT, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 53.5 | |
| BERT+CRF w/o demonstrationBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 52.31 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 52.07 | |
| instance-oriented demonstrationStrategy=SBERT, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 51.93 | |
| NNShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 44.93 | |
| StructShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 25.86 |