ResearchBenchmarksSentence Retrieval on 6 languages All transfersFollow27.1AccuracyTokMix14.93218.09121.2524.409May 26, 2023Evaluation ResultsMethodMethodLinksAccuracyTokMixTokenizer=TokMixTokenizer=TokMix2023.0527.1UnigramTokenizer=UnigramTokenizer=Unigram2023.0525.6BPETokenizer=BPETokenizer=BPE2023.0524.9NoOverlapTokenizer=NoOverlapTokenizer=NoOverlap2023.0515.4