List your company
ResearchFormerly WizWand

Tokenization on Programming Code

2.09NSL ScoreSutra
0.8941.20451.5151.8255Nov 5, 2025
Updated 7mo ago

Evaluation results

MethodLinks
SutraReference Model=Base LLaMA-42025.112.09
SarvamReference Model=Base LLaMA-42025.111.5
Gemma-3Reference Model=Base LLaMA-42025.111.31
Mistral-NemoReference Model=Base LLaMA-42025.111.15
Qwen-3Reference Model=Base LLaMA-42025.111.11
DeepSeek-R1Reference Model=Base LLaMA-42025.111.03
GPT-OSSReference Model=Base LLaMA-42025.111.03
LLaMA-3.2-1BReference Model=Base LLaMA-42025.111.02
LLaMA-4Reference Model=Base LLaMA-42025.111
MUTANT-IndicReference Model=Base LLaMA-42025.110.94