Knowledge-focused evaluation on MixEval Standard
33AccuracyFineInstructions
Evaluation results
| Method | Links | |
|---|---|---|
| FineInstructionsPre-training Corpus=Nemotron-CC Corpus (300B), Model Parameters=1.8B2026.01 | 33 | |
| FineInstructionsPre-training Corpus=IPT Corpus (23B), Model Parameters=1.8B2026.01 | 31.7 | |
| Q&APre-training Corpus=Nemotron-CC Corpus (300B), Model Parameters=1.8B2026.01 | 27.1 | |
| Nemotron-CCPre-training Corpus=Nemotron-CC Corpus (300B), Model Parameters=1.8B2026.01 | 24.5 | |
| Standard Pre-TrainingPre-training Corpus=Nemotron-CC Corpus (300B), Model Parameters=1.8B2026.01 | 24 | |
| WRAPPre-training Corpus=Nemotron-CC Corpus (300B), Model Parameters=1.8B2026.01 | 22.8 | |
| IPTPre-training Corpus=IPT Corpus (23B), Model Parameters=1.8B2026.01 | 19.8 | |
| Standard Pre-TrainingPre-training Corpus=IPT Corpus (23B), Model Parameters=1.8B2026.01 | 17.8 |