Named Entity Recognition on WikiAnn
93.7F1 ScoreByT5
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ByT5Scale=XXL, Evaluation Protocol=In-language multitask2021.05 | 93.7 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=XL, Evaluation Protocol=In-language multitask2021.05 | 92.6 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=XXL, Evaluation Protocol=In-language multitask2021.05 | 92.2 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Large, Evaluation Protocol=In-language multitask2021.05 | 91.8 | — | — | — | — | — | — | — | — | — | — | — | |
| InstructUIE2023.04 | 91.8 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Base, Evaluation Protocol=In-language multitask2021.05 | 91.6 | — | — | — | — | — | — | — | — | — | — | — | |
| TURNA-Encoder2024.01 | 91.54 | 91.08 | 92.01 | 97.08 | — | — | — | — | — | — | — | — | |
| mT5Scale=XL, Evaluation Protocol=In-language multitask2021.05 | 91.3 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Small, Evaluation Protocol=In-language multitask2021.05 | 90.6 | — | — | — | — | — | — | — | — | — | — | — | |
| TURNA2024.01 | 90.34 | 90.48 | 90.2 | 96.18 | — | — | — | — | — | — | — | — | |
| mT52024.01 | 90.2 | 90.5 | 89.9 | 95.93 | — | — | — | — | — | — | — | — | |
| BERTurk2024.01 | 90.12 | 89.83 | 90.41 | 96.53 | — | — | — | — | — | — | — | — | |
| mBART2024.01 | 89.93 | 90.76 | 89.12 | 95.84 | — | — | — | — | — | — | — | — | |
| mT5Scale=Large, Evaluation Protocol=In-language multitask2021.05 | 89.7 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=Base, Evaluation Protocol=In-language multitask2021.05 | 88.2 | — | — | — | — | — | — | — | — | — | — | — | |
| KnowCoderParameters=7B2026.04 | 87 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=Small, Evaluation Protocol=In-language multitask2021.05 | 86.4 | — | — | — | — | — | — | — | — | — | — | — | |
| InstructUIEBackbone=11B FlanT52023.04 | 85.13 | — | — | — | — | — | — | — | — | — | — | — | |
| B2NEREvaluation Protocol=Supervised2024.11 | 85.07 | — | — | — | — | — | — | — | — | — | — | — | |
| UniversalNERParameters=7B2026.04 | 84.91 | — | — | — | — | — | — | — | — | — | — | — | |
| KnowCoder-XEvaluation Protocol=Supervised2024.11 | 84.69 | — | — | — | — | — | — | — | — | — | — | — | |
| ProUIEParameters=4B2026.04 | 83.47 | — | — | — | — | — | — | — | — | — | — | — | |
| YAYI-UIEEvaluation Protocol=Supervised2024.11 | 72.63 | — | — | — | — | — | — | — | — | — | — | — | |
| BERTEvaluation Protocol=Supervised2024.11 | 70.6 | — | — | — | — | — | — | — | — | — | — | — | |
| Bert-baseBackbone=Bert-base2023.04 | 70.6 | — | — | — | — | — | — | — | — | — | — | — | |
| BERT-base2026.04 | 70.6 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=XXL, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 69.2 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=XXL, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 67.7 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=XL, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 65.5 | — | — | — | — | — | — | — | — | — | — | — | |
| JPT-4Bzero-shot=true2026.04 | 64.7 | — | — | — | — | — | — | — | — | — | — | — | |
| InstructUIEParameters=11B2026.04 | 64.47 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Large, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 62.9 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Base, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 62 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=XL, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 61.6 | — | — | — | — | — | — | — | — | — | — | — | |
| GLiNER-Lzero-shot=true2026.04 | 58.9 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=Large, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 58.5 | — | — | — | — | — | — | — | — | — | — | — | |
| ByT5Scale=Small, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 57.6 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=Base, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 55.7 | — | — | — | — | — | — | — | — | — | — | — | |
| UniNER-7Bzero-shot=true2026.04 | 55.4 | — | — | — | — | — | — | — | — | — | — | — | |
| mT5Scale=Small, Evaluation Protocol=Cross-lingual zero-shot transfer2021.05 | 50.5 | — | — | — | — | — | — | — | — | — | — | — | |
| BINOMIALCompression Rate=3x, Model Size=small-sized2025.07 | — | — | — | — | — | 63.8 | 75.06 | 67.59 | 78.06 | 61.21 | 48.31 | 65.67 | |
| BPECompression Rate=3x, Model Size=small-sized2025.07 | — | — | — | — | — | 52.3 | 67.7 | 64.94 | 74.99 | 60.23 | 48.18 | 61.39 | |
| FIXEDCompression Rate=3x, Model Size=small-sized2025.07 | — | — | — | — | — | 63.56 | 76.15 | 68.34 | 78.21 | 63.01 | 51.47 | 66.79 | |
| FXT λ1Compression Rate=3x, Model Size=small-sized, λ=12025.07 | — | — | — | — | — | 63.07 | 76.12 | 68.3 | 77.94 | 62.26 | 51.74 | 66.57 | |
| FXT λ2Compression Rate=3x, Model Size=small-sized, λ=22025.07 | — | — | — | — | — | 63.96 | 76.23 | 67.55 | 77.99 | 62.24 | 48.13 | 66.02 | |
| FXT λ3Compression Rate=3x, Model Size=small-sized, λ=32025.07 | — | — | — | — | — | 63.73 | 75.45 | 68.25 | 78.01 | 61.97 | 52.02 | 66.55 | |
| KnowCoderSetting=Supervised, Model Scale=7B2024.03 | — | — | — | — | 87 | — | — | — | — | — | — | — | |
| UniNERSetting=Supervised2024.03 | — | — | — | — | 85.4 | — | — | — | — | — | — | — |