ResearchTasksVocabulary AllocationVocabulary AllocationFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updated6 languages Averaged (test)TokMix2,198AR4Feb 26, 202620 languagesBPE809AR3Feb 26, 2026