TinyStories
Benchmarks
TaskDatasetSOTA resultTrendResults
TinyStories (val)
1.128Last Loss
21
TinyStories 21 (test)
1.62Speedup (x)
15
TinyStories 1K random samples (test)
39.7R-1
10
TinyStories
5.34Generation Perplexity (Gen-PPL)
8
TinyStories 60M tokens (val)
51.23PPL (Val)
8
TinyStories 10k (val)
1.128Validation Loss (nats/token)
7
TinyStories
76.93Image Quality
7
TinyStories (val)
8.54PPL
6
TinyStories
31.5Average Target Score
6
TinyStories high-D holdout
0.053RMSE (log space)
6
TinyStories high-C holdout
0.095RMSE (log space)
6
TinyStories
6.63Grammar
5
TinyStories GPT-4.1 Nano
6.47Grammar
5
TinyStories
6.37Grammar Score
5
TinyStories (test)
9.93Grammar
5
TinyStories long-context
2.95Perplexity (PPL)
2
TinyStories byte
2.298Perplexity
2
TinyStories char
2.304Perplexity
2
TinyStories
2Mean Queries
2
TinyStories
0p-value
2
TinyStories cleaned V2
0T-Test Statistic
2
TinyStories (test)
0t-test p-value
2
TinyStories Continual seed 123 (train)
0.434t-test (logits)
1
TinyStories seed 1000 Continual (train)
5.36t-test p-value (logits)
1