ResearchTasksTokenization Efficiency AnalysisTokenization Efficiency AnalysisFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedIndic and English corpusLLaMA-421.09Entropy6Mar 24, 2026