Tokenization Efficiency on Indic-English evaluation corpus ta
56NSL ScoreGPT-oss
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-oss2025.11 | 56 | |
| Sutra2025.11 | 47 | |
| Gemma-32025.11 | 45 | |
| Sarvam2025.11 | 45 | |
| MUTANT-Indic2025.11 | 38 |
| Method | Links | |
|---|---|---|
| GPT-oss2025.11 | 56 | |
| Sutra2025.11 | 47 | |
| Gemma-32025.11 | 45 | |
| Sarvam2025.11 | 45 | |
| MUTANT-Indic2025.11 | 38 |