Named Entity Recognition on BC5CDR 50 instances (test)
63.55F1 Scoreentity-oriented demonstration
Evaluation results
| Method | Links | |
|---|---|---|
| entity-oriented demonstrationStrategy=search, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 63.55 | |
| entity-oriented demonstrationStrategy=popular, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 63.4 | |
| entity-oriented demonstrationStrategy=popular, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 63.05 | |
| entity-oriented demonstrationStrategy=random, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 63.04 | |
| entity-oriented demonstrationStrategy=search, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.93 | |
| entity-oriented demonstrationStrategy=search, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.88 | |
| entity-oriented demonstrationStrategy=popular, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.87 | |
| entity-oriented demonstrationStrategy=random, Template=no-context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.57 | |
| entity-oriented demonstrationStrategy=random, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.3 | |
| BERT+CRF w/o demonstrationBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 62.1 | |
| instance-oriented demonstrationStrategy=SBERT, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 60.52 | |
| instance-oriented demonstrationStrategy=SBERT, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 60.09 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=lexical, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 59.9 | |
| instance-oriented demonstrationStrategy=BERTScore, Template=context, Backbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 58.95 | |
| NNShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 48.12 | |
| StructShotBackbone=bert-base-cased, Source Dataset=CoNLL03, Evaluation Protocol=Label Different2021.10 | 27.81 |