# Math Reasoning on MATH

Source: [Math Reasoning on MATH](<https://www.sota2.com/research/sota/math-reasoning-on-math>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-26T10:22:55.683Z

Evaluation of model performance on the MATH dataset focusing on standard accuracy and associated token costs.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Math Reasoning |
| Dataset (including any stated split) | MATH |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 160 of 160 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/math-reasoning-on-math.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Token Cost](<https://www.sota2.com/research/sota/math-reasoning-on-math.md?metric=Token%20Cost>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| XRPO | 90.54 | Not recorded | 68fa7c041e209131cea8be11 |
| GSPO | 90.33 | Not recorded | 68fa7c041e209131cea8be11 |
| DAPO | 89.33 | Not recorded | 68fa7c041e209131cea8be11 |
| GRPO | 88.4 | Not recorded | 6a02b434dbc836b87d82481b |
| GRPO | 88 | Not recorded | 6a02b434dbc836b87d82481b |
| GRPO | 86.4 | Not recorded | 6a02b434dbc836b87d82481b |
| GRPO | 86.2 | Not recorded | 6a02b434dbc836b87d82481b |
| TPO-S | 84.65 | Not recorded | 68fa7c041e209131cea8be11 |
| GRPO | 82.2 | Not recorded | 6a02b434dbc836b87d82481b |
| GRPO | 81.6 | Not recorded | 6a02b434dbc836b87d82481b |
| MoCAN | 75.5 | Not recorded | 693f95e16cfd488761a81843 |
| PeCAN | 75.2 | Not recorded | 693f95e16cfd488761a81843 |
| NSPO | 75.05 | Not recorded | 693f95e16cfd488761a81843 |
| Qwen2.5-7B-Instruct | 74.8 | Not recorded | 693f95e16cfd488761a81843 |
| BFPO | 74.55 | Not recorded | 693f95e16cfd488761a81843 |
| DPO-Mix | 74.4 | Not recorded | 693f95e16cfd488761a81843 |
| DPO-S | 74.27 | Not recorded | 693f95e16cfd488761a81843 |
| GRPO | 74.2 | Not recorded | 6a02b434dbc836b87d82481b |
| DPO-H | 74.05 | Not recorded | 693f95e16cfd488761a81843 |
| GRPO | 74 | Not recorded | 6a02b434dbc836b87d82481b |
| GWO/n=6+CoT | 73.8 | Not recorded | 69e85bc57d0172140ec81026 |
| OMI2 (Full) | 73.2 | Not recorded | 69e85bc57d0172140ec81026 |
| GRPO | 73 | Not recorded | 6a02b434dbc836b87d82481b |
| GWO+CoT | 72.8 | Not recorded | 69e85bc57d0172140ec81026 |
| GRPO | 72.6 | Not recorded | 6a02b434dbc836b87d82481b |
| OMI2 | 72.3 | Not recorded | 69e85bc57d0172140ec81026 |
| CODEI/O++ | 72.1 | Not recorded | 69e85bc57d0172140ec81026 |
| GWO | 72.1 | Not recorded | 69e85bc57d0172140ec81026 |
| CODEI/O | 71.9 | Not recorded | 69e85bc57d0172140ec81026 |
| PyEdu | 71.4 | Not recorded | 69e85bc57d0172140ec81026 |
| WI | 71.4 | Not recorded | 69e85bc57d0172140ec81026 |
| CoT-SC/n=5 | 71.2 | Not recorded | 69e85bc57d0172140ec81026 |
| WI (Full) | 71.1 | Not recorded | 69e85bc57d0172140ec81026 |
| GRPO | 71 | Not recorded | 6a02b434dbc836b87d82481b |
| OC-SFT-1 | 70.9 | Not recorded | 69e85bc57d0172140ec81026 |
| GRPO | 69.8 | Not recorded | 6a02b434dbc836b87d82481b |
| CoT | 69.7 | Not recorded | 69e85bc57d0172140ec81026 |
| Denser | 57.6 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 56.9 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 56.3 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 55.8 | Not recorded | 69438a98423ea422657294ad |
| Denser | 55.1 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 55 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 54.5 | Not recorded | 69438a98423ea422657294ad |
| Self-Consistency | 54.3 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 53.9 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 53.4 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 52.6 | Not recorded | 69438a98423ea422657294ad |
| Think-to-Think | 52.6 | Not recorded | 69438a98423ea422657294ad |
| Self-Consistency | 51.9 | Not recorded | 69438a98423ea422657294ad |
| Chain-of-Thought | 50.9 | Not recorded | 69438a98423ea422657294ad |
| Think-to-Think | 50.2 | Not recorded | 69438a98423ea422657294ad |
| Chain-of-Thought | 48.7 | Not recorded | 69438a98423ea422657294ad |
| Denser | 47.9 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 46.8 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 46.1 | Not recorded | 69438a98423ea422657294ad |
| Denser | 45.8 | Not recorded | 69438a98423ea422657294ad |
| Denser | 45.7 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 45.2 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 44.9 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 44.8 | Not recorded | 69438a98423ea422657294ad |
| SafeRLHF | 44.63 | Not recorded | 693f95e16cfd488761a81843 |
| TokenSkip (0.9 ratio) | 44.5 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 44.4 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 44.3 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 44.1 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 43.9 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 43.8 | Not recorded | 69438a98423ea422657294ad |
| Self-Consistency | 43.5 | Not recorded | 69438a98423ea422657294ad |
| Denser | 43.2 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 43 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 42.9 | Not recorded | 69438a98423ea422657294ad |
| Think-to-Think | 42.7 | Not recorded | 69438a98423ea422657294ad |
| Process Supervision | 42.6 | Not recorded | 69438a98423ea422657294ad |
| Self-Consistency | 42.4 | Not recorded | 69438a98423ea422657294ad |
| Self-Consistency | 42.3 | Not recorded | 69438a98423ea422657294ad |
| Reflection-CoT | 42 | Not recorded | 69438a98423ea422657294ad |
| Self-Verification | 41.5 | Not recorded | 69438a98423ea422657294ad |
| Chain-of-Thought (CoT) | 41.2 | Not recorded | 69438a98423ea422657294ad |
| Tree-of-Thought | 41.1 | Not recorded | 69438a98423ea422657294ad |

### XRPO

Accuracy: 90.54. Result ID: 6a157464fbc373592c0d7cfa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c041e209131cea8be11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c041e209131cea8be11.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### GSPO

Accuracy: 90.33. Result ID: 6a157464fbc373592c0d7cf7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c041e209131cea8be11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a481e209131cea8231d.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### DAPO

Accuracy: 89.33. Result ID: 6a157464fbc373592c0d7cf8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c041e209131cea8be11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 88.4. Result ID: 6a02c9ca47f34ce924e4f398.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B-Base","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 88. Result ID: 6a02c9ca47f34ce924e4f397.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B-Base","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 86.4. Result ID: 6a02c9ca47f34ce924e4f396.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B-Base","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 86.2. Result ID: 6a02c9ca47f34ce924e4f395.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B-Base","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### TPO-S

Accuracy: 84.65. Result ID: 6a157464fbc373592c0d7cf9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c041e209131cea8be11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ae51e209131cea85c12.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 82.2. Result ID: 6a02c9ca47f34ce924e4f390.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-Math-7B","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 81.6. Result ID: 6a02c9ca47f34ce924e4f38e.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-Math-7B","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### MoCAN

Accuracy: 75.5. Result ID: 69996a225698665ec4d78e4b.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c9d1e209131ce9d2b24.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### PeCAN

Accuracy: 75.2. Result ID: 69996a225698665ec4d78e4a.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c9d1e209131ce9d2b24.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### NSPO

Accuracy: 75.05. Result ID: 69996a225698665ec4d78e4e.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### Qwen2.5-7B-Instruct

Accuracy: 74.8. Result ID: 69996a225698665ec4d78e45.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74bf1e209131cea6378d.md>)

[Implementation](<https://github.com/QwenLM/Qwen2>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BFPO

Accuracy: 74.55. Result ID: 69996a225698665ec4d78e4d.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77d61e209131cea757e6.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### DPO-Mix

Accuracy: 74.4. Result ID: 69996a225698665ec4d78e48.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### DPO-S

Accuracy: 74.27. Result ID: 69996a225698665ec4d78e47.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 74.2. Result ID: 6a02c9ca47f34ce924e4f393.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B-Base","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### DPO-H

Accuracy: 74.05. Result ID: 69996a225698665ec4d78e46.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 74. Result ID: 6a02c9ca47f34ce924e4f394.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B-Base","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### GWO/n=6+CoT

Accuracy: 73.8. Result ID: 69e9c4b147f34ce924d0710b.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### OMI2 (Full)

Accuracy: 73.2. Result ID: 69e9c4b147f34ce924d07106.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 73. Result ID: 6a02c9ca47f34ce924e4f38f.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-Math-7B","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"true"}. This record does not assert independent reproduction.

### GWO+CoT

Accuracy: 72.8. Result ID: 69e9c4b147f34ce924d0710a.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 72.6. Result ID: 6a02c9ca47f34ce924e4f38d.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen2.5-Math-7B","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### OMI2

Accuracy: 72.3. Result ID: 69e9c4b147f34ce924d070ff.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### CODEI/O++

Accuracy: 72.1. Result ID: 69e9c4b147f34ce924d07100.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### GWO

Accuracy: 72.1. Result ID: 69e9c4b147f34ce924d07109.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### CODEI/O

Accuracy: 71.9. Result ID: 69e9c4b147f34ce924d07102.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### PyEdu

Accuracy: 71.4. Result ID: 69e9c4b147f34ce924d07101.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### WI

Accuracy: 71.4. Result ID: 69e9c4b147f34ce924d07104.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### CoT-SC/n=5

Accuracy: 71.2. Result ID: 69e9c4b147f34ce924d07108.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### WI (Full)

Accuracy: 71.1. Result ID: 69e9c4b147f34ce924d07105.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 71. Result ID: 6a02c9ca47f34ce924e4f392.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B-Base","QB (Query-preserved mini batching)":"true","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### OC-SFT-1

Accuracy: 70.9. Result ID: 69e9c4b147f34ce924d07103.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78be1e209131cea7a31c.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### GRPO

Accuracy: 69.8. Result ID: 6a02c9ca47f34ce924e4f391.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b434dbc836b87d82481b.md>)

Recorded evaluation configuration: {"Model":"Qwen3-1.7B-Base","QB (Query-preserved mini batching)":"false","RB (Reward-balanced batching)":"false"}. This record does not assert independent reproduction.

### CoT

Accuracy: 69.7. Result ID: 69e9c4b147f34ce924d07107.

[Reporting paper](<https://www.sota2.com/research/paper/69e85bc57d0172140ec81026.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Base":"Qwen2.5"}. This record does not assert independent reproduction.

### Denser

Accuracy: 57.6. Result ID: 6996bcce5698665ec407ae2a.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 56.9. Result ID: 6996bcce5698665ec407ae28.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 56.3. Result ID: 6996bcce5698665ec407ae27.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 55.8. Result ID: 6996bcce5698665ec407ae29.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Denser

Accuracy: 55.1. Result ID: 6996bcce5698665ec407ae22.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 55. Result ID: 6996bcce5698665ec407ae25.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 54.5. Result ID: 6996bcce5698665ec407ae20.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Self-Consistency

Accuracy: 54.3. Result ID: 6996bcce5698665ec407ae24.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 53.9. Result ID: 6996bcce5698665ec407ae1f.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 53.4. Result ID: 6996bcce5698665ec407ae21.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 52.6. Result ID: 6996bcce5698665ec407ae1d.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Think-to-Think

Accuracy: 52.6. Result ID: 6996bcce5698665ec407ae26.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79101e209131cea7bec1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Self-Consistency

Accuracy: 51.9. Result ID: 6996bcce5698665ec407ae1c.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Chain-of-Thought

Accuracy: 50.9. Result ID: 6996bcce5698665ec407ae23.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B-think"}. This record does not assert independent reproduction.

### Think-to-Think

Accuracy: 50.2. Result ID: 6996bcce5698665ec407ae1e.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79101e209131cea7bec1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Chain-of-Thought

Accuracy: 48.7. Result ID: 6996bcce5698665ec407ae1b.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction.

### Denser

Accuracy: 47.9. Result ID: 6996bcce5698665ec407ad78.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 46.8. Result ID: 6996bcce5698665ec407ad73.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 46.1. Result ID: 6996bcce5698665ec407ad72.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Denser

Accuracy: 45.8. Result ID: 6996bcce5698665ec407ae1a.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Denser

Accuracy: 45.7. Result ID: 6996bcce5698665ec407ae12.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 45.2. Result ID: 6996bcce5698665ec407ad71.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 44.9. Result ID: 6996bcce5698665ec407ae10.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 44.8. Result ID: 6996bcce5698665ec407ad6f.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### SafeRLHF

Accuracy: 44.63. Result ID: 69996a225698665ec4d78e49.

[Reporting paper](<https://www.sota2.com/research/paper/693f95e16cfd488761a81843.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e81e209131cea4ddd5.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction.

### TokenSkip (0.9 ratio)

Accuracy: 44.5. Result ID: 6996bcce5698665ec407ad77.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b681e209131cea883b4.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 44.4. Result ID: 6996bcce5698665ec407ae18.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 44.3. Result ID: 6996bcce5698665ec407ae0f.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 44.1. Result ID: 6996bcce5698665ec407ae19.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 43.9. Result ID: 6996bcce5698665ec407ae11.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 43.8. Result ID: 6996bcce5698665ec407ae17.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Self-Consistency

Accuracy: 43.5. Result ID: 6996bcce5698665ec407ad6e.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Denser

Accuracy: 43.2. Result ID: 6996bcce5698665ec407ae0a.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 43. Result ID: 6996bcce5698665ec407ae0d.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 42.9. Result ID: 6996bcce5698665ec407ae15.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Think-to-Think

Accuracy: 42.7. Result ID: 6996bcce5698665ec407ad70.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79101e209131cea7bec1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Process Supervision

Accuracy: 42.6. Result ID: 6996bcce5698665ec407ae08.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9a1e209131cea468c7.md>)

[Implementation](<https://github.com/openai/prm800k>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### Self-Consistency

Accuracy: 42.4. Result ID: 6996bcce5698665ec407ae0c.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B-think"}. This record does not assert independent reproduction.

### Self-Consistency

Accuracy: 42.3. Result ID: 6996bcce5698665ec407ae14.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b33.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B-no-think"}. This record does not assert independent reproduction.

### Reflection-CoT

Accuracy: 42. Result ID: 6996bcce5698665ec407ae07.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70cc1e209131cea4d38e.md>)

[Implementation](<https://github.com/noahshinn024/reflexion>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### Self-Verification

Accuracy: 41.5. Result ID: 6996bcce5698665ec407ae09.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e61e209131cea4dce1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

### Chain-of-Thought (CoT)

Accuracy: 41.2. Result ID: 6996bcce5698665ec407ad6d.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction.

### Tree-of-Thought

Accuracy: 41.1. Result ID: 6996bcce5698665ec407ae05.

[Reporting paper](<https://www.sota2.com/research/paper/69438a98423ea422657294ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71551e209131cea50930.md>)

[Implementation](<https://github.com/princeton-nlp/tree-of-thought-llm>)

Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction.

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/math-reasoning-on-math.md?metric=Accuracy&page=2>): Follow this link to discover more pages.
