Tokenization Efficiency
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
5.7Bytes per Token
6
Mar 24, 2026
1.95Bytes per Token
6
Mar 24, 2026
4.99Bytes/token
6
Mar 24, 2026
6.05Bytes per Token
6
Mar 24, 2026
3.84Bytes-per-Token
6
Mar 24, 2026
4.25NSL Score
5
Mar 24, 2026
71NSL Score
5
Mar 24, 2026
56NSL Score
5
Mar 24, 2026
3.63NSL Score
5
Mar 24, 2026
0.94NSL score
5
Mar 24, 2026
89NSL Score
5
Mar 24, 2026
96NSL Score
5
Mar 24, 2026
94NSL Score
5
Mar 24, 2026
2.19NSL Score
5
Mar 24, 2026
73NSL Score
5
Mar 24, 2026
99NSL Score
5
Mar 24, 2026
81NSL Score
5
Mar 24, 2026
1.19NSL Score
5
Mar 24, 2026
0.94NSL Score
5
Mar 24, 2026
76NSL Score
5
Mar 24, 2026
1.13NSL Score
5
Mar 24, 2026
1.27NSL Score
5
Mar 24, 2026
2.09NSL Score
5
Mar 24, 2026
83NSL Score
5
Mar 24, 2026
68,739,586Other Tokens
3
Mar 27, 2026