List your company
ResearchFormerly WizWand

Tokenization Efficiency on Punjabi (pa)

4.05Bytes per TokenLLaMA-4
3.8365.28056.7258.1695Nov 5, 2025
Updated 7mo ago

Evaluation results

MethodLinks
LLaMA-42025.114.05
Gemma-32025.114.62
GPT-oss2025.114.83
Sarvam-2B2025.117.95
Sutra2025.118.76
MUTANT-Indic2025.119.4