Named Entity Recognition on MIT
78.04Movie Entity ScoreLOCUS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LOCUSparams=470M, Evaluation Protocol=ours- few-shot2025.12 | 78.04 | 67.81 | 69.76 | |
| LOCUSminiparams=5M, Evaluation Protocol=ours- few-shot2025.12 | 77.8 | 66.14 | 69 | |
| JPT-8Bevaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 76.5 | 64.4 | — | |
| SaMBase Model=Llama3.1-8B, Training Strategy=SaM, Evaluation Setting=Zero-shot2025.06 | 72.17 | 52.99 | — | |
| SaM (MoE)evaluation_mode=zero-shot, paradigm=Generative2026.04 | 72.1 | 52.9 | — | |
| SaMBase Model=Qwen2.5-7B, Training Strategy=SaM, Evaluation Setting=Zero-shot2025.06 | 71.65 | 52.9 | — | |
| GNER-LLaMAparams=13B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 68.6 | 47.5 | 66.1 | |
| B2NEREvaluation Setting=Zero-shot2025.06 | 67.6 | 53.3 | — | |
| QwenBase Model=Qwen2.5-7B, Training Strategy=Fully-trained, Evaluation Setting=Zero-shot2025.06 | 66.66 | 52.69 | — | |
| LlamaBase Model=Llama3.1-8B, Training Strategy=Fully-trained, Evaluation Setting=Zero-shot2025.06 | 64.81 | 49.68 | — | |
| GLiNER-Levaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 64.4 | 42.9 | — | |
| InstructUIEEvaluation Setting=Zero-shot2025.06 | 63 | 20.99 | — | |
| GoLLIEEvaluation Setting=Zero-shot2025.06 | 63 | 43.4 | — | |
| InstructUIEparams=11B, Evaluation Protocol=zero-shot2025.12 | 63 | 21 | 47.2 | |
| GoLLIEparams=7B, Evaluation Protocol=zero-shot2025.12 | 63 | 43.4 | 58 | |
| GoLLIEparams=13B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 63 | 43.4 | 58.4 | |
| GoLLIEevaluation_mode=zero-shot, paradigm=Generative2026.04 | 63 | 43.4 | — | |
| InstructUIEevaluation_mode=zero-shot, paradigm=Generative2026.04 | 63 | 21 | — | |
| GNER-T5params=770M, Evaluation Protocol=instruction tuned or finetuned2025.12 | 62.5 | 51 | 69.1 | |
| UniNEREvaluation Setting=Zero-shot2025.06 | 61.2 | 35.2 | — | |
| UniNER-type+supparams=7B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 61.2 | 35.2 | 55.4 | |
| UniNER-7Bevaluation_mode=zero-shot, paradigm=Generative2026.04 | 61.2 | 35.2 | — | |
| JPT-4Bevaluation_mode=zero-shot, paradigm=Discriminative2026.04 | 60.7 | 63.4 | — | |
| GPT-4oparams=-, Evaluation Protocol=few-shot2025.12 | 60.12 | 55.28 | 62.95 | |
| GLiNEREvaluation Setting=Zero-shot, Parameters=300M2025.06 | 57.2 | 42.9 | — | |
| GLiNER-Lparams=450M, Evaluation Protocol=instruction tuned or finetuned2025.12 | 57.2 | 42.9 | 60.9 | |
| SLIMERparams=7B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 50.9 | 38.2 | 54 | |
| KnowCoderEvaluation Setting=Zero-shot2025.06 | 50 | 48.2 | — | |
| UniNER-13Bparams=13B, Evaluation Protocol=zero-shot2025.12 | 48.7 | 36.2 | 55.6 | |
| RA-IT (50K)params=8B, Evaluation Protocol=instruction tuned or finetuned2025.12 | 45.18 | 40.78 | 56.72 | |
| UniNER-7Bparams=7B, Evaluation Protocol=zero-shot2025.12 | 42.4 | 31.7 | 53.4 | |
| USMparams=2B, Evaluation Protocol=zero-shot2025.12 | 37.7 | 17.7 | 37.8 | |
| Vicuna-7Bparams=7B, Evaluation Protocol=zero-shot2025.12 | 6 | 5.3 | 13 | |
| GPT-3.5-turboparams=175B, Evaluation Protocol=zero-shot2025.12 | 5.3 | 32.8 | 47.5 | |
| Vicuna-13Bparams=13B, Evaluation Protocol=zero-shot2025.12 | 0.9 | 0.4 | 17.5 |