ResearchTasksVocabulary AllocationFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast Updated6 languages Averaged (test)TokMix2,198AR4Feb 26, 202620 languagesBPE809AR3Feb 26, 2026