Tokenization on 200-example (inference)
288Min Token Count (Inference)Llama-4
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Llama-4Tokenizer=Llama-42025.11 | 288 | 805 | 1,157 | 2,583 | 2,869 | 784 | |
| MUTANT-IndicTokenizer=MUTANT-Indic2025.11 | 178 | 440 | 541 | 654 | 676 | 379 |
Loading the SOTA2 catalog…