Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Tokenization research benchmarks – Page 3 · SOTA2 Research

Tokenization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

905.82Avg Tokens/Sample

3

Feb 26, 2026

200-example (inference)

288Min Token Count (Inference)

2

Mar 24, 2026

Page 3 of 3

Popular datasets

AI4Bharat Sangraha English Korean WikiText-103 Code

Follow for updates

Join SOTA2 Contact