ResearchBenchmarksTokenization Efficiency on Dogri doiFollow5.7Bytes per TokenLLaMA-45.61366.19686.787.3632Nov 5, 2025Evaluation ResultsMethodMethodLinksBytes per TokenLLaMA-42025.115.7GPT-oss2025.116.04Sarvam-2B2025.116.16Sutra2025.116.39Gemma-32025.116.75MUTANT-Indic2025.117.86