Named Entity Recognition on i2b2 2014
0.5821Micro F1 ScoreProML
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ProMLShot=5-shot2022.11 | 0.5821 | — | |
| TransferBERTShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.4789 | — | |
| DemonstrateNERShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.3636 | — | |
| TransferBERTShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.3525 | — | |
| ProtoBERTShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.3505 | — | |
| StructShotShot=5-shot, Evaluation Protocol=original paper2022.11 | 0.303 | — | |
| CONTAINERShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.3014 | — | |
| NNShotShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.295 | — | |
| StructShotShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.2708 | — | |
| ProMLShot=1-shot2022.11 | 0.2498 | — | |
| CONTAINERShot=5-shot, Evaluation Protocol=original paper2022.11 | 0.241 | — | |
| DualEncoderShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.2327 | — | |
| NNShotShot=5-shot, Evaluation Protocol=original paper2022.11 | 0.22 | — | |
| StructShotShot=1-shot, Evaluation Protocol=original paper2022.11 | 0.214 | — | |
| CONTAINERShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.1896 | — | |
| StructShotShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.1834 | — | |
| ProtoBERTShot=5-shot, Evaluation Protocol=original paper2022.11 | 0.179 | — | |
| CONTAINERShot=1-shot, Evaluation Protocol=original paper2022.11 | 0.164 | — | |
| ProtoBERTShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.1585 | — | |
| NNShotShot=1-shot, Evaluation Protocol=original paper2022.11 | 0.153 | — | |
| NNShotShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.15 | — | |
| DualEncoderShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.1463 | — | |
| EntLMShot=5-shot, Evaluation Protocol=reproduced2022.11 | 0.1351 | — | |
| ProtoBERTShot=1-shot, Evaluation Protocol=original paper2022.11 | 0.134 | — | |
| DemonstrateNERShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.1329 | — | |
| EntLMShot=1-shot, Evaluation Protocol=reproduced2022.11 | 0.0785 | — | |
| BERT2022.01 | — | 0.928 | |
| BioBERT2022.01 | — | 0.93 | |
| Clinical-Big Bird2022.01 | — | 0.952 | |
| Clinical-Longformer2022.01 | — | 0.961 | |
| ClinicalBERT2022.01 | — | 0.929 |