Mathematical Reasoning on MATH (SC/ORM/PRM Metrics)
66.6Standard Correctness (SC)SPARE-Qwen2.5-3B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPARE-Qwen2.5-3BN=20, Generator=Qwen2.5-3B Gen., Generation length=2048, Note=using pre-trained model2025.06 | 66.6 | 67.6 | 68.8 | 1.2 | |
| SPARE-Qwen2.5-3BN=20, Generator=Qwen2.5-32B Gen.2025.06 | 64.6 | 65.6 | 66 | 0.4 | |
| Math-ShepherdBackbone=DeepSeek-67B, N=2562025.06 | 45.4 | 47 | 48.1 | 1.1 | |
| Math-ShepherdBackbone=Mistral-7B, Training paradigm=Process RL Gen., N=2562025.06 | 42.3 | 43.1 | 43.5 | 0.4 | |
| Math-ShepherdBackbone=Mistral-7B, Training paradigm=SFT Gen., N=2562025.06 | 35.1 | 38 | 38.3 | 0.3 | |
| Rest-MCTS*Backbone=Mistral-7B, N=2562025.06 | 35.1 | 38 | 39 | 1 | |
| SPARE-Qwen2.5-3BN=20, Generator=Qwen2.5-3B Gen.2025.06 | 31.4 | 33.8 | 34.6 | 0.8 | |
| SPARE-Llama3-8BN=2562025.06 | 30.5 | 31.2 | 32.4 | 1.2 | |
| SPARE-Llama3-8BN=202025.06 | 23.4 | 23.8 | 24.1 | 0.3 |