Mathematical Reasoning on Minerva Math (Avg@16 Accuracy)
39Accuracy (Avg@16)PROF-BOTH
Evaluation Results
| Method | Links | |
|---|---|---|
| PROF-BOTHModel=Qwen2.5-Math-7B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 39 | |
| GRPOModel=Qwen2.5-Math-7B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 37.2 | |
| BlendModel=Qwen2.5-Math-7B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 36.7 | |
| PROF-POSModel=Qwen2.5-Math-7B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 36.6 | |
| PROF-POSModel=Qwen2.5-Math-1.5B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 31.3 | |
| PROF-BOTHModel=Qwen2.5-Math-1.5B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 30 | |
| GRPOModel=Qwen2.5-Math-1.5B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 29.1 | |
| BlendModel=Qwen2.5-Math-1.5B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 27.8 | |
| PROF-POSModel=LLaMA-3.2-3B-instruct, Temperature=1.0, Evaluation Protocol=average@162025.09 | 19.5 | |
| GRPOModel=LLaMA-3.2-3B-instruct, Temperature=1.0, Evaluation Protocol=average@162025.09 | 18.8 | |
| PROF-BOTHModel=LLaMA-3.2-3B-instruct, Temperature=1.0, Evaluation Protocol=average@162025.09 | 18 | |
| BlendModel=LLaMA-3.2-3B-instruct, Temperature=1.0, Evaluation Protocol=average@162025.09 | 13.1 | |
| BaseModel=Qwen2.5-Math-7B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 12.8 | |
| BaseModel=Qwen2.5-Math-1.5B-base, Temperature=1.0, Evaluation Protocol=average@162025.09 | 11.4 | |
| BaseModel=LLaMA-3.2-3B-instruct, Temperature=1.0, Evaluation Protocol=average@162025.09 | 8.8 |