Factuality Evaluation on SlimPajama
63.5Pointwise ScoreSelf-Improving Pretraining
Evaluation results
| Method | Links | |
|---|---|---|
| Self-Improving PretrainingTraining Data=SlimPajama, Pretraining for=Factuality2026.01 | 63.5 | |
| Llama BaseStage=Base Model2026.01 | 36.6 | |
| Llama Pretrain BaselineTraining Data=SlimPajama, Pretraining for=Factuality2026.01 | 35.4 |