Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Tokenization Efficiency research benchmarks – Page 3 · SOTA2 Research

Tokenization Efficiency

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

1.5-million sentence evaluation corpus English

7,904,670Other Tokens Count

3

Mar 27, 2026

1.5-million sentence evaluation corpus Hindi

18,394,075Other Tokens

3

Mar 27, 2026

1.5-million sentence evaluation corpus (Sinhala)

17,360,196Other Token Count

3

Mar 27, 2026

Page 3 of 3

Popular datasets

Indic-English evaluation corpus Indic-English Sentence Evaluation Corpus English Tamil

Follow for updates

Join SOTA2 Contact