Named Entity Recognition on Universal NER Benchmark (20 datasets) (test)
87.3ACE05 F1BERT-base
Evaluation results
| Method | Links | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BERT-baseBackbone=BERT-base2023.08 | 87.3 | 85.82 | 80.9 | 86.72 | 85.28 | 58.61 | 92.4 | 64.2 | 87.13 | 73.3 | 82.26 | 88.78 | 81.02 | 91.25 | 80.2 | 91.11 | 75.65 | 56.49 | 70.6 | 82.78 | 80.09 | |
| UniNERParameters=7B, Evaluation Protocol=in-domain supervised finetuning2023.08 | 86.69 | 88.65 | 82.42 | 89.21 | 89.34 | 81.25 | 93.3 | 81.87 | 98.3 | 77.54 | 74.21 | 90.17 | 82.35 | 93.73 | 86.96 | 89.91 | 65.67 | 65.77 | 84.91 | 93.28 | 84.78 | |
| InstructUIEParameters=11B, Evaluation Protocol=reevaluation2023.08 | 79.94 | 88.52 | 80.69 | 87.62 | 89.02 | 80.27 | 91.53 | 78.38 | 87.56 | 75.71 | 74.69 | 89.58 | 82.59 | 90.26 | 86.21 | 88.64 | 53.31 | 65.95 | 64.47 | 88.27 | 81.16 |