Language Understanding on MMLU (Math and Med Subject Scores)
45.2MMLU Math ScoreSingle-model
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Single-modelModel Group=Single-model2025.10 | 45.2 | 74.9 | |
| Com. 2Model Group=(a) General2025.10 | 45.1 | 77 | |
| Com. 2Model Group=(b) Mathematical2025.10 | 44.9 | 71.2 | |
| Com. 1Model Group=(c) Medical2025.10 | 44.1 | 73.8 | |
| Type-basedModel Group=Type-based, Configuration Identifier=(iii) Math2025.10 | 44 | 61.4 | |
| Type-basedModel Group=Type-based, Configuration Identifier=(i) General2025.10 | 41.6 | 74.4 | |
| All-modelsModel Group=All-models2025.10 | 41.1 | 76.5 | |
| Com. 1Model Group=(a) General2025.10 | 40.7 | 74.4 | |
| Type-basedModel Group=Type-based, Configuration Identifier=(iv) Med2025.10 | 40 | 80.7 | |
| Com. 2Model Group=(c) Medical2025.10 | 39.6 | 77 | |
| Random@3modelsModel Group=Random@3models2025.10 | 37.9 | 66.7 | |
| Com. 1Model Group=(b) Mathematical2025.10 | 37.5 | 78 | |
| Com. 3Model Group=(b) Mathematical2025.10 | 28.5 | 46 | |
| Com. 3Model Group=(a) General2025.10 | 27.6 | 40.6 | |
| Com. 3Model Group=(c) Medical2025.10 | 27.6 | 40.6 |