Tokenization Efficiency on Indic-English evaluation corpus code
2.09NSL ScoreSutra
Evaluation results
| Method | Links | |
|---|---|---|
| Sutra2025.11 | 2.09 | |
| Sarvam2025.11 | 1.5 | |
| Gemma-32025.11 | 1.31 | |
| GPT-oss2025.11 | 1.03 | |
| MUTANT-Indic2025.11 | 0.94 |
| Method | Links | |
|---|---|---|
| Sutra2025.11 | 2.09 | |
| Sarvam2025.11 | 1.5 | |
| Gemma-32025.11 | 1.31 | |
| GPT-oss2025.11 | 1.03 | |
| MUTANT-Indic2025.11 | 0.94 |