Mathematical Reasoning on GSM8K (Pass@1 Accuracy)
96.4GSM8K Pass@1 AccuracyClaude3.5-Sonnet
Evaluation results
| Method | Links | |
|---|---|---|
| Claude3.5-SonnetDecoding=Greedy2025.02 | 96.4 | |
| GPT-o1-miniDecoding=Greedy2025.02 | 94.8 | |
| GPT-4oDecoding=Greedy2025.02 | 92.9 | |
| Qwen2.5-Math-7B-S2R-ORLBackbone=Qwen2.5-Math-7B, Training Strategy=Outcome-level RL, Decoding=Greedy2025.02 | 92.9 | |
| Llama-3.1-8B-S2R-ORLBackbone=Llama-3.1-8B, Training Strategy=Outcome-level RL, Decoding=Greedy2025.02 | 87.3 | |
| Qwen2-7B-S2R-ORLBackbone=Qwen2-7B, Training Strategy=Outcome-level RL, Decoding=Greedy2025.02 | 86.4 |