Named Entity Recognition on Multiconer 2022 (test)
62.7English ScoreSupervised
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SupervisedSetting=Supervised2024.11 | 62.7 | 53.1 | 64.6 | 58.7 | 62.6 | 59.7 | 39.7 | 52.3 | 47.8 | 55.8 | 46.8 | 54.22 | 54.89 | |
| KnowCoder-XSetting=Zero-shot, Backbone=Baichuan2-7B-Base2024.11 | 56.37 | 47.53 | 49.87 | 54.17 | 48.81 | 41.53 | 24.13 | 30.83 | 29.67 | 33.56 | 43.19 | 39.53 | 41.79 | |
| B2NERSetting=Zero-shot, Backbone=InternLM2-7B2024.11 | 54.8 | 45.4 | 36.6 | 46 | 43 | 33.9 | — | — | — | — | — | 32.93 | 32.95 | |
| IEPILESetting=Zero-shot, Backbone=Baichuan2-13B2024.11 | 53.19 | 39.26 | 39.87 | 42.41 | 35.69 | 28.69 | 12.26 | 23.93 | 18.98 | 27.56 | 26.93 | 28.48 | 31.71 | |
| YAYI-UIESetting=Zero-shot, Backbone=Baichuan2-13B2024.11 | 52.04 | 37.89 | 41.78 | 42.44 | 38.02 | 30.97 | 15.97 | 21.96 | 20.93 | 26.45 | 30.74 | 29.92 | 32.65 | |
| GLINERSetting=Zero-shot2024.11 | 41.7 | 24.3 | 39.5 | 42.1 | 38.9 | 33.3 | 25.9 | 30.2 | 27.8 | 28.7 | 30 | 32.93 | 32.95 | |
| ChatGPTSetting=Zero-shot2024.11 | 37.2 | 18.8 | 37.1 | 34.7 | 35.7 | 27.4 | 23.3 | 25.9 | 27.3 | 30 | 31.9 | 30.37 | 29.94 |