Mathematical Reasoning on MATH (test) (Hit@1, Accuracy, and Token Usage)
51.8Hit@1MASPRM-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MASPRM-7BSearch=MCTS(10,3), Agent=Qwen2.5-1.5B-Instruct2025.10 | 51.8 | 9.4 | 32.9 | |
| MASPRM-7BSearch=SBS(5,3), Agent=Qwen2.5-1.5B-Instruct2025.10 | 51.3 | 12.1 | 50 | |
| MASPRM-7BSearch=SBS(5,1), Agent=Qwen2.5-1.5B-Instruct2025.10 | 50.4 | 5.5 | 20 | |
| MASPRM-7BSearch=SC@5, Agent=Qwen2.5-1.5B-Instruct2025.10 | 49.2 | 5.6 | 20 | |
| MASPRM-1.5BSearch=MCTS(10,3), Agent=Qwen2.5-1.5B-Instruct2025.10 | 47.3 | 9.5 | 33.7 | |
| ORM-1.5BSearch=SC@5, Agent=Qwen2.5-1.5B-Instruct2025.10 | 45.4 | 5.6 | 20 | |
| ORM-1.5BSearch=MCTS(10,3), Agent=Qwen2.5-1.5B-Instruct2025.10 | 45.3 | 9.8 | 33.6 | |
| MASPRM-1.5BSearch=SC@5, Agent=Qwen2.5-1.5B-Instruct2025.10 | 44.8 | 5.6 | 20 | |
| Qwen2.5-1.5B-InstructSearch=MCTS(10,3), Scorer=Policy Likelihood2025.10 | 42.5 | 9.8 | 34.5 | |
| Qwen2.5-1.5B-InstructSearch=SC@5, Scorer=None2025.10 | 42.4 | 5.6 | 20 | |
| Qwen2.5-1.5B-InstructSearch=SC@5, Scorer=Policy Likelihood2025.10 | 41.5 | 5.6 | 20 | |
| MASPRM-1.5BSearch=SBS(5,3), Agent=Qwen2.5-1.5B-Instruct2025.10 | 41.2 | 12.3 | 50 | |
| Qwen2.5-1.5B-InstructSearch=SBS(5,1), Scorer=Policy Likelihood2025.10 | 41 | 5.5 | 20 | |
| Qwen2.5-1.5B-InstructSearch=SBS(5,3), Scorer=Policy Likelihood2025.10 | 40.4 | 12.3 | 50 | |
| MASPRM-1.5BSearch=SBS(5,1), Agent=Qwen2.5-1.5B-Instruct2025.10 | 38.5 | 5.6 | 20 | |
| Qwen2.5-1.5B-InstructSearch=Single-Pass, Scorer=None2025.10 | 31 | 1.1 | 4 |