Named Entity Recognition on CrossNER zero-shot (test)
64F1 (Literature)UniNER-7B (refined)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| UniNER-7B (refined)refinement=true, backbone=7B2024.03 | 64 | 59.4 | 31.2 | 62.6 | 66.6 | 66.3 | 69.8 | 60 | |
| GOLLIE-7Brefinement=true, backbone=7B2024.03 | 62.7 | 63 | 43.4 | 59.1 | 67.8 | 57.2 | 55.5 | 58.4 | |
| KnowCoder-7Brefinement=false, backbone=7B2024.03 | 61.1 | 50 | 48.2 | 60.3 | 70 | 72.2 | 59.1 | 60.1 | |
| GOLLIE-13Brefinement=true, backbone=13B2024.03 | 59.7 | 62.5 | 49.8 | 56.7 | 65.5 | 54.4 | 56.2 | 57.8 | |
| UniNER-7Brefinement=false, backbone=7B2024.03 | 59.4 | 42.4 | 31.7 | 53.5 | 65 | 60.8 | 61.1 | 53.4 | |
| InstructUIE-11Brefinement=true, backbone=11B2024.03 | 48.4 | — | — | — | 48.8 | 54.4 | 49.9 | 49.4 | |
| ChatGPTrefinement=false2024.03 | 39.8 | 5.3 | 32.8 | 52.4 | 66.6 | 68.5 | 67 | 47.5 | |
| Vicuna-13Brefinement=false, backbone=13B2024.03 | 22.7 | 0.9 | 0.4 | 22.7 | 26.6 | 27.2 | 22 | 17.5 | |
| Vicuna-7Brefinement=false, backbone=7B2024.03 | 16.1 | 6 | 5.3 | 12.8 | 17 | 20.5 | 13 | 13 |