Mathematical Reasoning on MATH (test) (accuracy (r*), self-reward (r_self))
70.6Accuracy (r*)Qwen / Base
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen / BaseSampling=Power, Evaluation Protocol=All completions2026.05 | 70.6 | 0.093 | |
| Qwen / DistilledSampling=Standard, Evaluation Protocol=Self-reward Best-of-N2026.05 | 68.2 | 0.064 | |
| Qwen / BaseSampling=Power, Evaluation Protocol=Self-reward Best-of-N2026.05 | 67.7 | 0.08 | |
| Qwen / DistilledSampling=Temperature, Evaluation Protocol=Self-reward Best-of-N2026.05 | 67.6 | 0.06 | |
| Qwen / DistilledSampling=Temperature, Evaluation Protocol=All completions2026.05 | 66.1 | 0.073 | |
| Qwen / DistilledSampling=Standard, Evaluation Protocol=All completions2026.05 | 63.1 | 0.094 | |
| Qwen / BaseSampling=Standard, Evaluation Protocol=Self-reward Best-of-N2026.05 | 57.9 | 0.185 | |
| Phi / BaseSampling=Power, Evaluation Protocol=All completions2026.05 | 51.3 | 0.175 | |
| Phi / BaseSampling=Power, Evaluation Protocol=Self-reward Best-of-N2026.05 | 49.3 | 0.155 | |
| Phi / DistilledSampling=Standard, Evaluation Protocol=Self-reward Best-of-N2026.05 | 48.1 | 0.088 | |
| Phi / BaseSampling=Standard, Evaluation Protocol=Self-reward Best-of-N2026.05 | 47.6 | 0.173 | |
| Phi / DistilledSampling=Standard, Evaluation Protocol=All completions2026.05 | 47 | 0.118 | |
| Phi / DistilledSampling=Temperature, Evaluation Protocol=Self-reward Best-of-N2026.05 | 46.1 | 0.086 | |
| Phi / DistilledSampling=Temperature, Evaluation Protocol=All completions2026.05 | 45.7 | 0.106 | |
| Phi / BaseSampling=Standard, Evaluation Protocol=All completions2026.05 | 44.9 | 0.234 | |
| Qwen / BaseSampling=Standard, Evaluation Protocol=All completions2026.05 | 41 | 0.405 |