Per-word fertility on FLORES-200
1.431Fertility (En)Sarvam-1
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Sarvam-1Vocab=68K2026.05 | 1.431 | 2.648 | 3.129 | 2.521 | |
| Tekken/Sarvam-mVocab=131K2026.05 | 1.267 | 1.432 | 1.659 | 1.405 | |
| Sarvam-30BVocab=262K2026.05 | 1.237 | 1.489 | 1.642 | 1.348 | |
| BrahmicTokenizer-131KVocab=131K2026.05 | 1.235 | 1.464 | 1.653 | 1.388 |