English fine-tuning corpus
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
English fine-tuning corpus 60B tokens
0.817Observed Loss
3
English fine-tuning corpus 30B tokens
0.847Observed Loss
3
English fine-tuning corpus 3B tokens
0.904Observed Loss
3