Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Pre-training dataset and benchmarks · SOTA2 Research

Research Datasets

Pre-training

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Language Modeling

Pre-training (val)

1.602Validation Loss

64

Pre-training (evaluation)

3.254Pre-training Eval Loss

5

Pre-training efficiency

Pre-training

4,228Muon Steps

4

Popular tasks

Language Modeling Pre-training Pre-training efficiency

Follow for updates

Join SOTA2 Contact