# Mathematical Reasoning on GSM-Plus

Source: [Mathematical Reasoning on GSM-Plus](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-30T08:25:32.795Z

Evaluation of model performance on the GSM-Plus dataset for mathematical reasoning, focusing on accuracy across various perturbation and rephrasing conditions.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Mathematical Reasoning |
| Dataset (including any stated split) | GSM-Plus |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 217 of 217 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Acc (Num. Pert.)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Acc%20(Num.%20Pert.)>): Higher is better; unit: PERCENT.

- [Acc (Rephrase)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Acc%20(Rephrase)>): Higher is better; unit: PERCENT.

- [Acc (Distract)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Acc%20(Distract)>): Higher is better; unit: PERCENT.

- [Acc (Original)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Acc%20(Original)>): Higher is better; unit: PERCENT.

- [TFR](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=TFR>): Higher is better; unit: PERCENT.

- [Avg@4 Accuracy](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Avg%404%20Accuracy>): Higher is better; unit: PERCENT.

- [Length](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Length>): Higher is better; unit: SCALAR.

- [Performance Gain (%)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Performance%20Gain%20(%25)>): Higher is better; unit: PERCENT.

- [Acc (Exact-match)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Acc%20(Exact-match)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen3-32B | 84.98 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-14B | 84.31 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-14B | 84.15 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 83.82 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-14B | 83.71 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 83.71 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-14B | 83.71 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 83.67 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-32B | 83.15 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LRS | 82.86 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-32B | 82.62 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 82.62 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR | 82.62 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-32B | 82.62 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 82.52 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-8B | 82.11 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-8B | 81.88 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS | 81.79 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-8B | 81.29 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 81.29 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-8B | 81.29 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-70B | 81.25 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 81.04 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LRS | 81.04 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 80.82 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-70B | 80.72 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR+ERSS | 80.46 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 79.9 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR | 79.88 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-4B | 79.88 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-70B | 79.84 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 79.84 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-70B | 79.84 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-4B | 79.76 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS | 79.76 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR+LRS | 79.46 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS+LRS | 79.02 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-4B | 78.9 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 78.9 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-4B | 78.9 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS | 77.98 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR | 77.87 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 77.85 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LRS | 77.82 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 77.8 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 76.43 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-1.7B | 76.28 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS | 75.66 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-1.7B | 75.45 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 75.45 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-1.7B | 75.45 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Qwen3-1.7B | 75.43 | Not recorded | 6a2258aa86173ad9c1468c25 |
| CoLD | 73.8 | Not recorded | 68fa7a2b1e209131cea8182c |
| ALRR | 72.57 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Loose Lips Sink Ships | 72.5 | Not recorded | 68fa7a2b1e209131cea8182c |
| LRS | 72.45 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 72.4 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Adaptive Length Bias Mitigation | 72.2 | Not recorded | 68fa7a2b1e209131cea8182c |
| CoLD(w/o Joint) | 72.1 | Not recorded | 68fa7a2b1e209131cea8182c |
| Length Penalty | 71.5 | Not recorded | 68fa7a2b1e209131cea8182c |
| LRS | 71.26 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR | 71.16 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Vanilla-Base-PRM | 71 | Not recorded | 68fa7a2b1e209131cea8182c |
| ERSS | 70.8 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 70.79 | Not recorded | 6a2258aa86173ad9c1468c25 |
| l2-guided Selection | 70.57 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LRS | 70.57 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Uniform Average | 70.4 | Not recorded | 68fa7a2b1e209131cea8182c |
| Locally Weighted Regression | 69.6 | Not recorded | 68fa7a2b1e209131cea8182c |
| ALRR | 68.25 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-8B | 68.25 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-8B | 67.95 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Base (Mean@8) | 67.95 | Not recorded | 6a2258aa86173ad9c1468c25 |
| Baseline | 67.95 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-8B | 67.95 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ICaRus | 67.5 | Not recorded | 69b8e0060636e5bf4afbe98d |
| ALRR+LRS | 67.38 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ALRR+ERSS | 66.86 | Not recorded | 6a2258aa86173ad9c1468c25 |
| LLaMA-8B | 66.43 | Not recorded | 6a2258aa86173ad9c1468c25 |
| ERSS | 66.43 | Not recorded | 6a2258aa86173ad9c1468c25 |

### Qwen3-32B

Accuracy: 84.98. Result ID: 6a229a66fbc373592c212809.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### Qwen3-14B

Accuracy: 84.31. Result ID: 6a229a66fbc373592c212807.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### Qwen3-14B

Accuracy: 84.15. Result ID: 6a229a66fbc373592c2126a3.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 83.82. Result ID: 6a229a66fbc373592c212705.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-14B"}. This record does not assert independent reproduction.

### Qwen3-14B

Accuracy: 83.71. Result ID: 6a229a66fbc373592c2126a2.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 83.71. Result ID: 6a229a66fbc373592c212704.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-14B"}. This record does not assert independent reproduction.

### Qwen3-14B

Accuracy: 83.71. Result ID: 6a229a66fbc373592c212806.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 83.67. Result ID: 6a229a66fbc373592c212707.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-32B"}. This record does not assert independent reproduction.

### Qwen3-32B

Accuracy: 83.15. Result ID: 6a229a66fbc373592c2126a5.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### LRS

Accuracy: 82.86. Result ID: 6a229a66fbc373592c21279d.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4"}. This record does not assert independent reproduction.

### Qwen3-32B

Accuracy: 82.62. Result ID: 6a229a66fbc373592c2126a4.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 82.62. Result ID: 6a229a66fbc373592c212706.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-32B"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 82.62. Result ID: 6a229a66fbc373592c21279b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4"}. This record does not assert independent reproduction.

### Qwen3-32B

Accuracy: 82.62. Result ID: 6a229a66fbc373592c212808.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 82.52. Result ID: 6a229a66fbc373592c212703.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-8B"}. This record does not assert independent reproduction.

### Qwen3-8B

Accuracy: 82.11. Result ID: 6a229a66fbc373592c212805.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### Qwen3-8B

Accuracy: 81.88. Result ID: 6a229a66fbc373592c2126a1.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 81.79. Result ID: 6a229a66fbc373592c21279c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4"}. This record does not assert independent reproduction.

### Qwen3-8B

Accuracy: 81.29. Result ID: 6a229a66fbc373592c2126a0.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 81.29. Result ID: 6a229a66fbc373592c212702.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-8B"}. This record does not assert independent reproduction.

### Qwen3-8B

Accuracy: 81.29. Result ID: 6a229a66fbc373592c212804.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### LLaMA-70B

Accuracy: 81.25. Result ID: 6a229a66fbc373592c2126a9.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 81.04. Result ID: 6a229a66fbc373592c212701.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### LRS

Accuracy: 81.04. Result ID: 6a229a66fbc373592c2127ad.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 80.82. Result ID: 6a229a66fbc373592c21270b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"LLaMA-70B"}. This record does not assert independent reproduction.

### LLaMA-70B

Accuracy: 80.72. Result ID: 6a229a66fbc373592c21280d.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### ALRR+ERSS

Accuracy: 80.46. Result ID: 6a229a66fbc373592c2127ae.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 79.9. Result ID: 6a229a66fbc373592c212700.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 79.88. Result ID: 6a229a66fbc373592c2127ab.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Qwen3-4B

Accuracy: 79.88. Result ID: 6a229a66fbc373592c212803.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### LLaMA-70B

Accuracy: 79.84. Result ID: 6a229a66fbc373592c2126a8.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 79.84. Result ID: 6a229a66fbc373592c21270a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"LLaMA-70B"}. This record does not assert independent reproduction.

### LLaMA-70B

Accuracy: 79.84. Result ID: 6a229a66fbc373592c21280c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Qwen3-4B

Accuracy: 79.76. Result ID: 6a229a66fbc373592c21269f.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 79.76. Result ID: 6a229a66fbc373592c2127ac.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### ALRR+LRS

Accuracy: 79.46. Result ID: 6a229a66fbc373592c2127b0.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### ERSS+LRS

Accuracy: 79.02. Result ID: 6a229a66fbc373592c2127af.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Qwen3-4B

Accuracy: 78.9. Result ID: 6a229a66fbc373592c21269e.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 78.9. Result ID: 6a229a66fbc373592c2127aa.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Qwen3-4B

Accuracy: 78.9. Result ID: 6a229a66fbc373592c212802.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 77.98. Result ID: 6a229a66fbc373592c2127a8.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-12B-it"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 77.87. Result ID: 6a229a66fbc373592c2127a7.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-12B-it"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 77.85. Result ID: 6a229a66fbc373592c21279a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4"}. This record does not assert independent reproduction.

### LRS

Accuracy: 77.82. Result ID: 6a229a66fbc373592c2127a9.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-12B-it"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 77.8. Result ID: 6a229a66fbc373592c2127a6.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-12B-it"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 76.43. Result ID: 6a229a66fbc373592c2126ff.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### Qwen3-1.7B

Accuracy: 76.28. Result ID: 6a229a66fbc373592c212801.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 75.66. Result ID: 6a229a66fbc373592c2127a0.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4-Reasoning"}. This record does not assert independent reproduction.

### Qwen3-1.7B

Accuracy: 75.45. Result ID: 6a229a66fbc373592c21269c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 75.45. Result ID: 6a229a66fbc373592c2126fe.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### Qwen3-1.7B

Accuracy: 75.45. Result ID: 6a229a66fbc373592c212800.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Qwen3-1.7B

Accuracy: 75.43. Result ID: 6a229a66fbc373592c21269d.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### CoLD

Accuracy: 73.8. Result ID: 6a0d6db3fbc373592c056092.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 72.57. Result ID: 6a229a66fbc373592c21279f.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4-Reasoning"}. This record does not assert independent reproduction.

### Loose Lips Sink Ships

Accuracy: 72.5. Result ID: 6a0d6db3fbc373592c05608d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa715c1e209131cea50db8.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### LRS

Accuracy: 72.45. Result ID: 6a229a66fbc373592c2127a1.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4-Reasoning"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 72.4. Result ID: 6a229a66fbc373592c21279e.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Phi-4-Reasoning"}. This record does not assert independent reproduction.

### Adaptive Length Bias Mitigation

Accuracy: 72.2. Result ID: 6a0d6db3fbc373592c05608e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### CoLD(w/o Joint)

Accuracy: 72.1. Result ID: 6a0d6db3fbc373592c056091.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### Length Penalty

Accuracy: 71.5. Result ID: 6a0d6db3fbc373592c05608c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74131e209131cea5fa65.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### LRS

Accuracy: 71.26. Result ID: 6a229a66fbc373592c2127a5.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-4B-it"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 71.16. Result ID: 6a229a66fbc373592c2127a3.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-4B-it"}. This record does not assert independent reproduction.

### Vanilla-Base-PRM

Accuracy: 71. Result ID: 6a0d6db3fbc373592c05608b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 70.8. Result ID: 6a229a66fbc373592c2127a4.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-4B-it"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 70.79. Result ID: 6a229a66fbc373592c2127a2.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"Gemma3-4B-it"}. This record does not assert independent reproduction.

### l2-guided Selection

Accuracy: 70.57. Result ID: 6a229a66fbc373592c212709.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"LLaMA-8B"}. This record does not assert independent reproduction.

### LRS

Accuracy: 70.57. Result ID: 6a229a66fbc373592c2127b4.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

### Uniform Average

Accuracy: 70.4. Result ID: 6a0d6db3fbc373592c05608f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b741e209131cea8895b.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### Locally Weighted Regression

Accuracy: 69.6. Result ID: 6a0d6db3fbc373592c056090.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a2b1e209131cea8182c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b741e209131cea8895b.md>)

Recorded evaluation configuration: {"Policy Model":"Llama-3-70B-Instruct"}. This record does not assert independent reproduction.

### ALRR

Accuracy: 68.25. Result ID: 6a229a66fbc373592c2127b2.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

### LLaMA-8B

Accuracy: 68.25. Result ID: 6a229a66fbc373592c21280b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Recur"}. This record does not assert independent reproduction.

### LLaMA-8B

Accuracy: 67.95. Result ID: 6a229a66fbc373592c2126a6.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### Base (Mean@8)

Accuracy: 67.95. Result ID: 6a229a66fbc373592c212708.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"LLaMA-8B"}. This record does not assert independent reproduction.

### Baseline

Accuracy: 67.95. Result ID: 6a229a66fbc373592c2127b1.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

### LLaMA-8B

Accuracy: 67.95. Result ID: 6a229a66fbc373592c21280a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Base"}. This record does not assert independent reproduction.

### ICaRus

Accuracy: 67.5. Result ID: 69b9024247f34ce924a11d81.

[Reporting paper](<https://www.sota2.com/research/paper/69b8e0060636e5bf4afbe98d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b8e0060636e5bf4afbe98d.md>)

Recorded evaluation configuration: {"Model":"Qwen3-8B-Base","KV Sharing":"O"}. This record does not assert independent reproduction.

### ALRR+LRS

Accuracy: 67.38. Result ID: 6a229a66fbc373592c2127b7.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

### ALRR+ERSS

Accuracy: 66.86. Result ID: 6a229a66fbc373592c2127b5.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

### LLaMA-8B

Accuracy: 66.43. Result ID: 6a229a66fbc373592c2126a7.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Setting":"Steer"}. This record does not assert independent reproduction.

### ERSS

Accuracy: 66.43. Result ID: 6a229a66fbc373592c2127b3.

[Reporting paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2258aa86173ad9c1468c25.md>)

Recorded evaluation configuration: {"Model":"R1-Distilled-LLaMA-8B"}. This record does not assert independent reproduction.

Page 1 of 3. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm-plus.md?metric=Accuracy&page=2>): Follow this link to discover more pages.
