Mathematical Reasoning on Minerva (pass@1, standard deviation)
45.96Pass@1MIPU
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MIPUModel=Qwen3-4B, Rollout Quantization=FP82026.06 | 45.96 | — | |
| MISModel=Qwen3-4B, Rollout Quantization=FP82026.06 | 44.12 | — | |
| LR-decayModel=Qwen3-4B, Rollout Quantization=FP82026.06 | 43.75 | — | |
| GRPO BaselineModel=Qwen3-4B, Rollout Quantization=FP82026.06 | 43.39 | — | |
| MISModel=Qwen3-1.7B, Rollout Quantization=FP82026.06 | 34.19 | — | |
| MIPUModel=Qwen3-1.7B, Rollout Quantization=FP82026.06 | 33.82 | — | |
| GRPO BaselineModel=Qwen3-1.7B, Rollout Quantization=FP82026.06 | 31.68 | — | |
| LR-decayModel=Qwen3-1.7B, Rollout Quantization=FP82026.06 | 28.68 | — | |
| UniRBackbone=Qwen2.5-3B, Trained Model=1.5B, Zero-shot=true, Temperature=0.62025.05 | 26.3 | — | |
| GRPO FullBackbone=Qwen2.5-3B, Trained Model=3B, Zero-shot=true, Temperature=0.62025.05 | 25 | — | |
| GRPO LoRABackbone=Qwen2.5-3B, Trained Model=3B, Zero-shot=true, Temperature=0.62025.05 | 24.7 | — | |
| Backbone + 1.5BBackbone=Qwen2.5-3B, Zero-shot=true, Temperature=0.62025.05 | 20.7 | — | |
| DeepSeekMath-7B-RLTrained Model=7B, Zero-shot=true, Temperature=0.62025.05 | 20.6 | — | |
| Backbone onlyBackbone=Qwen2.5-3B, Zero-shot=true, Temperature=0.62025.05 | 19.2 | — | |
| NuminaMath-7B-CoTTrained Model=7B, Zero-shot=true, Temperature=0.62025.05 | 19.1 | — | |
| Internlm2-math-plus-7BTrained Model=7B, Zero-shot=true, Temperature=0.62025.05 | 17.3 | — | |
| UniRBackbone=Llama3.2-3B, Trained Model=1B, Zero-shot=true, Temperature=0.62025.05 | 16.6 | — | |
| Mathstral-7B-v0.1Trained Model=7B, Zero-shot=true, Temperature=0.62025.05 | 16.2 | — | |
| Backbone + 1BBackbone=Llama3.2-3B, Zero-shot=true, Temperature=0.62025.05 | 13.1 | — | |
| Backbone onlyBackbone=Llama3.2-3B, Zero-shot=true, Temperature=0.62025.05 | 12.5 | — | |
| GRPO LoRABackbone=Llama3.2-3B, Trained Model=3B, Zero-shot=true, Temperature=0.62025.05 | 12 | — | |
| GRPO FullBackbone=Llama3.2-3B, Trained Model=3B, Zero-shot=true, Temperature=0.62025.05 | 11.6 | — |