General Knowledge on MMLU (Average Accuracy)
82.7MMLU AccuracyQwen3-14B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-14BParameters=14B2026.01 | 82.7 | 70.5 | 76.6 | |
| Mi:dm 2.0 Base-instType=Instruction-tuned2026.01 | 73.7 | 53.3 | 63.5 | |
| Qwen3-4BParameters=4B2026.01 | 73.3 | — | 73.3 | |
| Llama-3.1-8B-instParameters=8B, Type=Instruction-tuned2026.01 | 70.7 | 47.6 | 59.2 | |
| Exaone-3.5-7.8B-instParameters=7.8B, Type=Instruction-tuned2026.01 | 69 | 40.7 | 54.8 | |
| Exaone-3.5-2.4B-instParameters=2.4B, Type=Instruction-tuned2026.01 | 59.5 | — | 59.5 | |
| Mi:dm 2.0 Mini-instType=Instruction-tuned2026.01 | 56.5 | — | 56.5 |