Named Entity Recognition on CrossNER (test)
65.54Micro-F1SCIR-RUIE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SCIR-RUIEframework=SCIR, backbone=RUIE2025.12 | 65.54 | — | — | |
| RUIE2025.12 | 65.41 | — | — | |
| SCIR-OneKEframework=SCIR, backbone=OneKE2025.12 | 63.7 | — | — | |
| SCIR-DeepSeek-R1framework=SCIR, backbone=DeepSeek-R1-Distill-Qwen3-8B2025.12 | 62.67 | — | — | |
| SCIR-Qwen3framework=SCIR, backbone=Qwen3-8B2025.12 | 61.51 | — | — | |
| OneKE2025.12 | 60.91 | — | — | |
| ChunkUIE2025.12 | 58.13 | — | — | |
| IEPile-LLama2backbone=LLaMA2-13B, tuning=LoRA2025.12 | 56.5 | — | — | |
| SCIR-LLama3.1framework=SCIR, backbone=LLama3.1-8B2025.12 | 54.71 | — | — | |
| YAYI-UIE2025.12 | 50.39 | — | — | |
| DeepSeek-R1backbone=DeepSeek-R1-Distill-Qwen3-8B, mode=untuned2025.12 | 37.84 | — | — | |
| Qwen3backbone=Qwen3-8B, mode=untuned2025.12 | 30.9 | — | — | |
| LLama3.1backbone=LLama3.1-8B, mode=untuned2025.12 | 26.65 | — | — | |
| AEiOBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=monolithic prompting, Number of entity types=382026.06 | — | 34.61 | 30.8 | |
| CROSSAGENTIEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate, Number of entity types=382026.06 | — | 46.15 | 44.4 | |
| G&OBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting, Number of entity types=382026.06 | — | 27 | 25.38 | |
| One-StepBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting, Number of entity types=382026.06 | — | 25.45 | 23.65 | |
| SMADE-IEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate, Number of entity types=382026.06 | — | 65.5 | 60.56 |