Multi-step Reasoning on GSM8K (test)
32.2Pass@1SLR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SLRBackbone=Qwen2026.02 | 32.2 | 60 | 71.6 | 79.4 | 85 | 90.5 | |
| Proxy-SoupBackbone=Qwen2026.02 | 28 | 52.5 | 62.3 | 68.9 | 73.6 | 76.8 | |
| SLRBackbone=Gemma2026.02 | 21.2 | 45.6 | 59 | 70.7 | 79.1 | 84.2 | |
| SLRBackbone=Llama2026.02 | 15.4 | 42.9 | 61.2 | 77.8 | 88.9 | 94.7 | |
| Proxy-SoupBackbone=Llama2026.02 | 13.6 | 37.5 | 52.7 | 66.3 | 75.9 | 80 | |
| Proxy-SoupBackbone=Gemma2026.02 | 8.3 | 20.5 | 29.5 | 37.6 | 42.3 | 44.2 | |
| Post-trainedBackbone=Qwen2026.02 | 7.4 | 25 | 40.4 | 56.3 | 66.7 | 72.6 | |
| Post-trainedBackbone=Llama2026.02 | 4.5 | 16.2 | 28.2 | 44 | 58 | 66.3 | |
| Post-trainedBackbone=Gemma2026.02 | 1.1 | 4 | 7.5 | 13 | 19.9 | 26.3 |