Mathematical Reasoning on Minerva-Math (Accuracy %)
57.4AccuracyNemotron-49B (Teacher)
Evaluation results
| Method | Links | |
|---|---|---|
| Nemotron-49B (Teacher)Model Role=Teacher, Category=Off-the-shelf Models2026.06 | 57.4 | |
| KL Annealing onlySEAD Components=KL Annealing only, Category=Proposed2026.06 | 56.6 | |
| Token Zones + KL AnnealingSEAD Components=Token Zones + KL Annealing, Category=Proposed2026.06 | 54.8 | |
| Token Zones onlySEAD Components=Token Zones only, Category=Proposed2026.06 | 54 | |
| GRPOCategory=Baselines2026.06 | 53.7 | |
| OPD (RKL)Category=Baselines2026.06 | 53.3 | |
| Nemotron-8B (Student)Model Role=Student, Category=Off-the-shelf Models2026.06 | 52.9 | |
| OPSDCategory=Baselines2026.06 | 49.6 | |
| VRPOBase Model=Qwen3-8B2025.08 | 31.99 | |
| λ-GRPOBase Model=Qwen3-8B2025.08 | 31.62 | |
| KTAEBase Model=Qwen3-8B2025.08 | 29.41 | |
| BaseBase Model=Qwen3-8B2025.08 | 28.68 | |
| VRPOBase Model=Qwen2.5-7B-Cold Start2025.08 | 19.85 | |
| KTAEBase Model=Qwen2.5-7B-Cold Start2025.08 | 19.12 | |
| BaseBase Model=Qwen2.5-7B-Cold Start2025.08 | 18.75 | |
| λ-GRPOBase Model=Qwen2.5-7B-Cold Start2025.08 | 18.38 |