ResearchBenchmarksVocabulary Allocation on 20 languagesFollow809ARBPE615.56665.78716766.22May 26, 2023Evaluation ResultsMethodMethodLinksARCPTBPEProbing=trueProbing=true2023.058093.43TokMixProbing=trueProbing=true2023.056893.23UnigramProbing=trueProbing=true2023.056232.89