Mathematical Reasoning on MINERVA (Pass@8)
37.6Avg Score @8vOPDtop-k
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| vOPDtop-kModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 37.6 | 54.4 | 45.3 | |
| vOPDfull-VModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 37.2 | 54 | 45.4 | |
| OPDfull-VModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 36.3 | 53.3 | 45.1 | |
| OPDModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 35.3 | 54 | 42.9 | |
| OPDtop-kModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 35.3 | 52.2 | 42.8 | |
| vOPDfull-VModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 26.2 | 48.9 | 33.1 | |
| vOPDtop-kModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 25.2 | 44.5 | 33 | |
| OPDfull-VModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 25 | 44.5 | 33 | |
| vOPDtop-kModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 23.9 | 41.9 | 33.1 | |
| OPDtop-kModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 23.4 | 44.5 | 30.2 | |
| vOPDfull-VModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 22.5 | 40.4 | 32.9 | |
| OPDModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 22.2 | 40.8 | 29.8 | |
| OPDfull-VModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 21.7 | 43 | 31.8 | |
| OPDtop-kModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 21.5 | 39 | 29.5 | |
| OPDModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 18.4 | 36 | 29.9 | |
| StudentModel Setup=Qwen3-4B → Qwen3-4B-Base2026.05 | 15.9 | 45.2 | 28.4 | |
| StudentModel Setup=Qwen3-1.7B → Qwen3-1.7B-Base2026.05 | 13.8 | 37.1 | 20.6 | |
| StudentModel Setup=Olmo-3-7B-Think → Olmo-3-7B-Base2026.05 | 11.6 | 35.3 | 20.2 |