Named Entity Recognition on ACE04
87.6Micro-F1SOTA (Lu et al., 2022)
Evaluation Results
| Method | Links | |
|---|---|---|
| SOTA (Lu et al., 2022)Setting=Supervised2024.03 | 87.6 | |
| KnowCoderSetting=Supervised, Model Scale=7B2024.03 | 86.2 | |
| APIEModel=Deepseek-v3-660B2025.08 | 48.56 | |
| Active-PromptModel=Deepseek-v3-660B2025.08 | 47.33 | |
| APIEModel=Gemma-3-12B2025.08 | 44.42 | |
| Active-PromptModel=Gemma-3-12B2025.08 | 43.61 | |
| APIEModel=Deepseek-R1-14B2025.08 | 41.95 | |
| Active-PromptModel=Deepseek-R1-14B2025.08 | 41.19 | |
| KD SortModel=Gemma-3-12B2025.08 | 40.11 | |
| RSLModel=Gemma-3-12B2025.08 | 39.76 | |
| KD SortModel=Deepseek-v3-660B2025.08 | 38.62 | |
| RSLModel=Deepseek-v3-660B2025.08 | 33.31 | |
| APIEModel=Qwen-2.5-14B2025.08 | 32.61 | |
| RSLModel=Deepseek-R1-14B2025.08 | 31.5 | |
| KD SortModel=Deepseek-R1-14B2025.08 | 31.24 | |
| RSLModel=Qwen-2.5-14B2025.08 | 30.05 | |
| Active-PromptModel=Qwen-2.5-14B2025.08 | 30.03 | |
| KD SortModel=Qwen-2.5-14B2025.08 | 29.31 | |
| ZSLModel=Deepseek-v3-660B2025.08 | 24.87 | |
| ZSLModel=Gemma-3-12B2025.08 | 22.48 | |
| ZSLModel=Deepseek-R1-14B2025.08 | 17.76 | |
| ZSLModel=Qwen-2.5-14B2025.08 | 10.78 |