Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Tokenization Intrinsic Evaluation research benchmarks · SOTA2 Research

Tokenization Intrinsic Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

FLORES+ 30-lang

PA-BPE (ratios)

0.027Compression Rate

6

Jul 7, 2026

mC4 unbalanced 60-lang (test)

0.021Compression Rate

5

Jul 7, 2026

Popular datasets

Follow for updates

Join SOTA2 Contact