Multiple Choice Question Answering on Bolmo 7B Evaluation Suite MC Non-STEM
77.7Average Score (Non-STEM)Olmo 3 7B
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Olmo 3 7B# Parameters (incl. Embed)=7.30B2025.12 | 77.7 | 69.2 | 75.2 | 66.9 | 75.2 | 80.3 | 80.4 | 92.9 | 62.5 | 85.5 | 69.6 | 96.8 | |
| Bolmo 7B# Parameters (incl. Embed)=7.63B2025.12 | 75.8 | 67.2 | 74 | 65.1 | 73.6 | 79.4 | 79.1 | 90 | 59.1 | 84.8 | 65.9 | 95.8 | |
| TFree-Hat 7B# Parameters (incl. Embed)=7.19B2025.12 | 66.5 | 57.4 | 72 | 65 | 75.4 | 79.8 | 79.3 | 91.2 | 24.9 | 90.5 | 70.7 | 25.8 | |
| EvaByte 6.5B# Parameters (incl. Embed)=6.49B2025.12 | 63.8 | 52.7 | 57.4 | 50.9 | 91.4 | 65.3 | 79.6 | 63.2 | 41.1 | 67.8 | 43.8 | 88.8 | |
| BLT 7B# Parameters (incl. Embed)=10.55B2025.12 | 56.6 | 52.2 | 54 | 49.3 | 52.2 | 62.9 | 50.6 | 71.4 | 31 | 77.5 | 50.1 | 71 |