Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

OpenWebText dataset and benchmarks – Page 4 · SOTA2 Research

Research Datasets

OpenWebText

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Language Modeling

OpenWebText 10k

11.502Perplexity

3

Language Modeling

OpenWebText GPT-2 (train)

3.41Loss

3

Text reconstruction

openwebtext

3.09Perplexity (PPL)

3

OpenWebText Quality

88.2Balanced Accuracy

3

OpenWebText Mainstream

92.4Balanced Accuracy

3

OpenWebText Politics

95.6Balanced Accuracy

3

OpenWebText AI subset

95.7Balanced Acc

3

OpenWebText Climate

96.7Balanced Acc

3

Self-attention inverse temperature scaling analysis

OpenWebText (OWT)

5.7Tie (%)

2

Text Generation

OpenWebText (OWT) (test)

0.85MAUVE

2

Page 4 of 4

Popular tasks

Language Modeling Text Generation Unconditional Text Generation Next-token prediction Unconditional Generation

Follow for updates

Join SOTA2 Contact