Reasoning on MMLU-Pro (Score %)
78MMLU-Pro Reasoning ScoreDR-Rubric-8B (BS-3)
Evaluation Results
| Method | Links | |
|---|---|---|
| DR-Rubric-8B (BS-3)Training=SFT+RL, 3K2026.05 | 78 | |
| DR-Rubric-8B (Gemini)Training=SFT+RL, 1K2026.05 | 75 | |
| DR-Rubric-8B (GPT-5)Training=SFT+RL, 1K2026.05 | 74.8 | |
| Qwen2.5-7B2026.05 | 74.3 | |
| Qwen3-8B-SFTTraining=SFT, 1K2026.05 | 73.8 | |
| Qwen3-8B2026.05 | 73.3 | |
| WebExplorer-8BTraining=SFT+RL, 25K2026.05 | 71.5 | |
| DR-Tulu-SFT-8BTraining=SFT, 16K2026.05 | 71 | |
| Pair+Backbone=olmo-3.1-32b-it-sft2026.04 | 69.4 | |
| MPO+Backbone=olmo-3.1-32b-it-sft2026.04 | 69.3 | |
| Soft+Backbone=olmo-3.1-32b-it-sft2026.04 | 69.1 | |
| DR-Tulu-RL-8BTraining=SFT+RL, 25K2026.05 | 69 | |
| Search-R1-7BTraining=RL, 90K2026.05 | 68 | |
| DPOBackbone=olmo-3.1-32b-it-sft2026.04 | 67.9 | |
| Mag+Backbone=olmo-3.1-32b-it-sft2026.04 | 67.3 | |
| RFTBackbone=olmo-3.1-32b-it-sft2026.04 | 58.2 | |
| BaseBackbone=olmo-3.1-32b-it-sft2026.04 | 57 | |
| Pair+Backbone=olmo-3-7b-it-sft2026.04 | 55.2 | |
| TeacherMethod ID=C0, Distillation Strategy=Teacher, Training Stage=Before SFT+DPO2026.05 | 55.2 | |
| Mag+Backbone=olmo-3-7b-it-sft2026.04 | 55 | |
| RSAMethod ID=C3, Distillation Strategy=RSA, Training Stage=Before SFT+DPO2026.05 | 55 | |
| HEEDMethod ID=C4, Distillation Strategy=HEED, Training Stage=Before SFT+DPO2026.05 | 55 | |
| MPO+Backbone=olmo-3-7b-it-sft2026.04 | 54.8 | |
| HSAMethod ID=C2, Distillation Strategy=HSA, Training Stage=Before SFT+DPO2026.05 | 54.4 | |
| KDMethod ID=C1, Distillation Strategy=KD, Training Stage=Before SFT+DPO2026.05 | 53.9 | |
| Soft+Backbone=olmo-3-7b-it-sft2026.04 | 53.6 | |
| DPOBackbone=olmo-3-7b-it-sft2026.04 | 51.6 | |
| RFTBackbone=olmo-3-7b-it-sft2026.04 | 46.3 | |
| BaseBackbone=olmo-3-7b-it-sft2026.04 | 45.6 | |
| Soft+Backbone=gemma-3-4b-sft2026.04 | 37.5 | |
| DPOBackbone=gemma-3-4b-sft2026.04 | 36.7 | |
| MPO+Backbone=gemma-3-4b-sft2026.04 | 36.2 | |
| Mag+Backbone=gemma-3-4b-sft2026.04 | 34.7 | |
| Pair+Backbone=gemma-3-4b-sft2026.04 | 33.5 | |
| RFTBackbone=gemma-3-4b-sft2026.04 | 32.8 | |
| BaseBackbone=gemma-3-4b-sft2026.04 | 31.5 |