Per-word fertility on FLORES-200 (dev+devtest)
1.43Per-word Fertility (En)Sarvam-1
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sarvam-1Vocab=68K2026.05 | 1.43 | 1.4 | 2.05 | 2.16 | 2.13 | 2.4 | 2.83 | 1.78 | 1.8 | 1.68 | 2.33 | 4.75 | 2.3 | |
| IndicBERTv2-SSVocab=200K2026.05 | 1.35 | 1.25 | 5.04 | 8.1 | 6.62 | 6.69 | 8.67 | 1.47 | 4.99 | 3.91 | 5.58 | 5.23 | 5.23 | |
| Krutrim-1Vocab=70K2026.05 | 1.33 | 3.3 | 4.62 | 6.73 | 5.68 | 6.12 | 7.35 | 4.94 | 4.02 | 3.24 | 4.85 | 4.49 | 5.03 | |
| Tekken/Sarvam-mVocab=131K2026.05 | 1.27 | 1.94 | 2.92 | 3.59 | 3.7 | 3.83 | 4.74 | 3.14 | 3.62 | 3.2 | 18.18 | 4.72 | 4.87 | |
| Qwen3-8BVocab=152K2026.05 | 1.26 | 4.75 | 7.1 | 10 | 11.35 | 11.84 | 13.29 | 6.7 | 8.86 | 7.76 | 13.6 | 7.7 | 9.36 | |
| Sarvam-30BVocab=262K2026.05 | 1.24 | 1.39 | 1.68 | 2.36 | 2.32 | 2.56 | 2.94 | 2 | 1.93 | 1.63 | 1.97 | 2.82 | 2.14 | |
| Gemma-3-1BVocab=262K2026.05 | 1.24 | 1.39 | 1.68 | 2.36 | 2.83 | 3.26 | 3.33 | 2 | 2.4 | 2.82 | 4.83 | 2.82 | 2.7 | |
| BrahmicTokenizer-131KVocab=131K2026.05 | 1.24 | 1.64 | 2.33 | 3.12 | 3.03 | 3.27 | 3.47 | 2.57 | 2.27 | 2.6 | 4.13 | 2.75 | 2.84 | |
| Llama-3.1-8BVocab=128K2026.05 | 1.24 | 2.67 | 7.99 | 12.28 | 13.23 | 14.9 | 16.16 | 3.99 | 9.91 | 8.19 | 16.78 | 8.59 | 10.43 | |
| DeepSeek-R1Vocab=129K2026.05 | 1.23 | 2.95 | 2.79 | 4.92 | 5.97 | 6.21 | 7.94 | 4.27 | 4.98 | 4.68 | 7.61 | 3.76 | 5.1 | |
| GPT-OSS-120BVocab=200K2026.05 | 1.22 | 1.64 | 2.33 | 3.15 | 3.05 | 3.3 | 3.5 | 2.57 | 2.29 | 2.72 | 6.79 | 2.76 | 3.1 |