Named Entity Recognition on SciERC
82.71F1 ScoreZ-NERD
Evaluation Results
| Method | Links | |
|---|---|---|
| Z-NERD2026.03 | 82.71 | |
| HGEREEvaluation Protocol=Supervised2026.03 | 81.19 | |
| Z-NERD w/o OSDAblation=Without Orthogonal Semantic Decomposition2026.03 | 80.27 | |
| Z-NERD2026.03 | 78.84 | |
| HGEREEvaluation Protocol=Supervised2026.03 | 75.92 | |
| Z-NERD w/o TCQKAblation=Without Multi-Scale TCQK2026.03 | 75.12 | |
| Z-NERD w/o OSDAblation=Without Orthogonal Semantic Decomposition2026.03 | 74.39 | |
| PL-MarkerEvaluation Protocol=Supervised2026.03 | 74.04 | |
| Z-NERD w/o TCQKAblation=Without Multi-Scale TCQK2026.03 | 73.43 | |
| UniversalNER-7bEvaluation Protocol=Supervised2026.03 | 73.13 | |
| SciBERTEvaluation Protocol=Supervised2026.03 | 70.71 | |
| PL-MarkerEvaluation Protocol=Supervised2026.03 | 70.32 | |
| DyGIE++training_data=full, paradigm=multi-task learning2021.01 | 69.8 | |
| RDANERtraining_data=full2021.01 | 68.96 | |
| SpERTtraining_data=full, paradigm=multi-task learning2021.01 | 67.62 | |
| SciBERTEvaluation Protocol=Supervised2026.03 | 67.52 | |
| UniversalNER-7bEvaluation Protocol=Supervised2026.03 | 66.09 | |
| llama-3.3-70bEvaluation Protocol=Zero-Shot2026.03 | 49.57 | |
| qwen3-32bEvaluation Protocol=Zero-Shot2026.03 | 46.52 | |
| llama-3.3-70bEvaluation Protocol=Zero-Shot2026.03 | 46.2 | |
| APIEModel=Deepseek-v3-660B2025.08 | 42.05 | |
| Active-PromptModel=Deepseek-v3-660B2025.08 | 41.89 | |
| qwen3-32bEvaluation Protocol=Zero-Shot2026.03 | 41.63 | |
| RSLModel=Deepseek-v3-660B2025.08 | 40.43 | |
| KD SortModel=Deepseek-v3-660B2025.08 | 37.98 | |
| llama-3.1-8b-instantEvaluation Protocol=Zero-Shot2026.03 | 33.96 | |
| ZSLModel=Deepseek-v3-660B2025.08 | 33.44 | |
| APIEModel=Deepseek-R1-14B2025.08 | 33.09 | |
| APIEModel=Qwen-2.5-14B2025.08 | 31.4 | |
| llama-3.1-8b-instantEvaluation Protocol=Zero-Shot2026.03 | 31.21 | |
| Active-PromptModel=Deepseek-R1-14B2025.08 | 30.82 | |
| RSLModel=Gemma-3-12B2025.08 | 29.57 | |
| KD SortModel=Deepseek-R1-14B2025.08 | 29.17 | |
| Active-PromptModel=Qwen-2.5-14B2025.08 | 29.11 | |
| RSLModel=Qwen-2.5-14B2025.08 | 27.94 | |
| KD SortModel=Qwen-2.5-14B2025.08 | 27.42 | |
| KD SortModel=Gemma-3-12B2025.08 | 27.25 | |
| RSLModel=Deepseek-R1-14B2025.08 | 26.87 | |
| APIEModel=Gemma-3-12B2025.08 | 26.21 | |
| ZSLModel=Deepseek-R1-14B2025.08 | 26.19 | |
| Active-PromptModel=Gemma-3-12B2025.08 | 25.45 | |
| ZSLModel=Gemma-3-12B2025.08 | 24.12 | |
| ZSLModel=Qwen-2.5-14B2025.08 | 20.51 |