ResearchTasksTokenization Efficiency AnalysisFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedIndic and English corpusLLaMA-421.09Entropy6Mar 24, 2026