Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Pre-training extrapolation research benchmarks · SOTA2 Research

Pre-training extrapolation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Table 2 configurations All 10

Generalized Opt-Law

0.2Mean Relative Error

4

May 21, 2026

configurations 100B loss-equivalent Table 2

Generalized Opt-Law

0.2Mean Relative Error

4

May 21, 2026

Table 2 configurations 100B multi-phase

Generalized Opt-Law

0.2Mean Relative Error

4

May 21, 2026

configurations 300B single-phase Table 2

Generalized Opt-Law

0.1Mean Relative Error

4

May 21, 2026

Popular datasets

configurations Table configurations Table 2 configurations

Follow for updates

Join SOTA2 Contact