Knowledge Accuracy on MMLU Redux
91.7Knowledge Accuracy (MMLU Redux)Qwen3.5-9B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3.5-9BParameters=9B, Variant=Thinking2026.05 | 91.7 | |
| Qwen3.5-4BParameters=4B, Variant=Thinking2026.05 | 88.3 | |
| Mellum 2 (RL)Post-training Stage=RL, Parameters=2.5B/12B, Variant=Thinking2026.05 | 86.2 | |
| Mellum 2 (SFT)Post-training Stage=SFT, Parameters=2.5B/12B, Variant=Thinking2026.05 | 84.8 | |
| Ministral-3-14BParameters=14B, Variant=Thinking2026.05 | 84.4 | |
| OLMo-3-7BParameters=7B, Variant=Thinking2026.05 | 71.3 |