Bolmo 1B Evaluation Suite
58.5Overall Average ScoreBLT 1B
Evaluation results
| Method | Links | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BLT 1BModel Category=Open-Weight Byte-Level LMs, Number of Parameters (incl. Embed)=4.53B2025.12 | 58.5 | 59.9 | 40.6 | 69.2 | 71 | 67 | 54.6 | 77.3 | 81.7 | 37.7 | 79.5 | 46.6 | 76.4 | 87 | 59.6 | 78 | 27.5 | 28.7 | 65.9 | 33.1 | 26.2 | 81.1 | 37.6 | |
| OLMo 2 1BModel Category=Subword LMs, Number of Parameters (incl. Embed)=1.48B2025.12 | 58.3 | 61.4 | 40.4 | 66 | 68.9 | 65.2 | 55.1 | 76.4 | 77.4 | 52.7 | 76.4 | 46.8 | 87.4 | 87.5 | 64 | 72.9 | 25.2 | 27.8 | 60.1 | 31.1 | 28 | 85 | 27.5 | |
| Bolmo 1BModel Category=Fully-Open Byte-Level LMs, Number of Parameters (incl. Embed)=1.47B2025.12 | 58.2 | 59 | 37.2 | 64.2 | 67 | 65.7 | 54.7 | 74.9 | 81.7 | 43.1 | 69.6 | 40.9 | 83.4 | 85 | 63 | 73.3 | 26.5 | 27.8 | 65.2 | 30.5 | 26.1 | 82.5 | 60 | |
| H-Net XL (2-stage)Model Category=Open-Weight Byte-Level LMs, Number of Parameters (incl. Embed)=1.60B, Training Stage=2-stage2025.12 | 53.2 | 62.3 | 38.7 | 62.4 | 63.6 | 60.9 | 52.9 | 74 | 72.8 | 33.6 | 70.8 | 35.9 | 77.1 | 88.3 | 51.1 | 58.5 | 27.5 | 25.9 | 49.4 | 32.1 | 28.2 | 80.5 | 24.2 | |
| H-Net XL (1-stage)Model Category=Open-Weight Byte-Level LMs, Number of Parameters (incl. Embed)=1.27B, Training Stage=1-stage2025.12 | 52.5 | 61.8 | 37.5 | 61.4 | 60.2 | 58.9 | 50.1 | 73.6 | 73.7 | 33.4 | 72.3 | 34.5 | 76.7 | 85.8 | 63 | 55.9 | 27.7 | 28.7 | 48.1 | 30.9 | 29.3 | 73.8 | 17.4 |