Named Entity Recognition on CoNLL++
0.954F1 ScoreSpanDec (RoBERTa-L)
Evaluation Results
| Method | Links | |
|---|---|---|
| SpanDec (RoBERTa-L)Params=0.35B, Throughput=118.7 (1×)2026.04 | 0.954 | |
| CL-KLEvaluation Setting=W/ CONTEXT2021.05 | 0.9481 | |
| CL-L2Evaluation Setting=W/ CONTEXT2021.05 | 0.9462 | |
| W/ CONTEXT (Baseline)Evaluation Setting=W/ CONTEXT2021.05 | 0.9456 | |
| CL-KLEvaluation Setting=W/O CONTEXT2021.05 | 0.9455 | |
| CL-L2Evaluation Setting=W/O CONTEXT2021.05 | 0.9438 | |
| Wang et al.2021.05 | 0.9428 | |
| W/O CONTEXT (Baseline)Evaluation Setting=W/O CONTEXT2021.05 | 0.942 | |
| LUKEEvaluation Setting=W/O CONTEXT2021.05 | 0.9399 | |
| UniNERParams=7B, Throughput=< 6.4 (0.05×)2026.04 | 0.933 | |
| GLiNERParams=0.35B, Throughput=76.2 (0.64×)2026.04 | 0.925 | |
| InstructUIEParams=13B, Throughput=< 5.8 (0.05×)2026.04 | 0.915 | |
| GPT-NERParams=175B, Throughput=< 5 (0.04×)2026.04 | 0.909 | |
| LLaMA3-8BParams=8B, Throughput=< 9 (0.08×)2026.04 | 0.8537 | |
| LLaMA2-7BParams=7B, Throughput=< 9 (0.08×)2026.04 | 0.7653 | |
| SOLARParams=10.7B, Throughput=< 8 (0.07×)2026.04 | 0.7603 | |
| Mistral-12BParams=12B, Throughput=< 7 (0.06×)2026.04 | 0.7423 | |
| LLaMA2-13BParams=13B, Throughput=< 7 (0.06×)2026.04 | 0.6824 |