Tokenization Efficiency on Indic-English evaluation corpus mni
2.19NSL ScoreSarvam
Evaluation results
| Method | Links | |
|---|---|---|
| Sarvam2025.11 | 2.19 | |
| Sutra2025.11 | 0.92 | |
| MUTANT-Indic2025.11 | 0.91 | |
| GPT-oss2025.11 | 0.89 | |
| Gemma-32025.11 | 0.81 |
| Method | Links | |
|---|---|---|
| Sarvam2025.11 | 2.19 | |
| Sutra2025.11 | 0.92 | |
| MUTANT-Indic2025.11 | 0.91 | |
| GPT-oss2025.11 | 0.89 | |
| Gemma-32025.11 | 0.81 |