ResearchBenchmarksNamed Entity Recognition on 20 languagesNamed Entity Recognition on 20 languagesFollow66.3F1 ScoreBPE31.87640.81349.7558.687May 26, 2023Evaluation resultsMethodMethodLinksF1 ScoreBPEProbing=trueProbing=true2023.0566.3TokMixProbing=trueProbing=true2023.0565.4UnigramProbing=trueProbing=true2023.0558.9BPETokenizer=BPETokenizer=BPE2023.0536.6TokMixTokenizer=TokMixTokenizer=TokMix2023.0536.5UnigramTokenizer=UnigramTokenizer=Unigram2023.0533.2