ResearchBenchmarksNamed Entity Recognition on 20 languages All transfersFollow0.388F1 ScoreBPE0.352640.361820.3710.38018May 26, 2023Evaluation ResultsMethodMethodLinksF1 ScoreBPETokenizer=BPETokenizer=BPE2023.050.388TokMixTokenizer=TokMixTokenizer=TokMix2023.050.387UnigramTokenizer=UnigramTokenizer=Unigram2023.050.354