Language Understanding and Reasoning on OLMES Standard
75.9ARC-Easy AccuracyOLMo-2-0425-1B
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OLMo-2-0425-1BTraining Tokens=4T, Evaluation Protocol=after pretraining2025.09 | 75.9 | 46.2 | 68 | 68.7 | 67.8 | 53 | 75.3 | 54.2 | 67.4 | 26.9 | |
| RMSNormEvaluation Setting=Zero-shot, Model Parameters=8B2026.03 | 75.9 | 45.3 | 73.2 | 68.5 | 70.4 | 50.4 | 74.8 | 56.5 | 66.8 | 37.9 | |
| OLMo-2-1BTraining Tokens=210B, Evaluation Protocol=after pretraining2025.09 | 74.1 | 42.4 | 68 | 64.8 | 62.4 | 47.2 | 73.4 | 52.9 | 61 | 27.8 | |
| MXNorm (p=2)Evaluation Setting=Zero-shot, Model Parameters=8B, p=22026.03 | 74.1 | 45.8 | 72.6 | 67.1 | 71.5 | 54.2 | 76.2 | 55.5 | 65.2 | 38 | |
| MXNorm (p=1)Evaluation Setting=Zero-shot, Model Parameters=8B, p=12026.03 | 73.7 | 39.1 | 56.6 | 62.4 | 68.1 | 49.8 | 74.5 | 52.5 | 64.4 | 37.2 |