# Advanced Mathematical Reasoning on Math500 (512 tokens)

Source: [Advanced Mathematical Reasoning on Math500 (512 tokens)](<https://www.sota2.com/research/sota/advanced-mathematical-reasoning-on-math500-512-tokens>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:57:33.852Z

Evaluation of model performance on the Math500 dataset, specifically using the 512-token context, for Advanced Mathematical Reasoning, reporting pass@1 accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Advanced Mathematical Reasoning |
| Dataset (including any stated split) | Math500 512 tokens |
| Metric | Pass@1 Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Pass@1 Accuracy](<https://www.sota2.com/research/sota/advanced-mathematical-reasoning-on-math500-512-tokens.md?metric=Pass%401%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Pass@1 Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| d-TreeRPO | 46.3 | Not recorded | 693a4ffd6cfd488761a549dd |
| TraceRL | 44.1 | Not recorded | 693a4ffd6cfd488761a549dd |
| Diffu-GRPO | 43.4 | Not recorded | 693a4ffd6cfd488761a549dd |
| wd1 | 43.4 | Not recorded | 693a4ffd6cfd488761a549dd |
| LLaDA-MoE-7BA1B-Instruct | 42.2 | Not recorded | 693a4ffd6cfd488761a549dd |
| GDPO | 41.2 | Not recorded | 693a4ffd6cfd488761a549dd |
| SAPO | 40.4 | Not recorded | 693a4ffd6cfd488761a549dd |
| TraceRL | 39.1 | Not recorded | 693a4ffd6cfd488761a549dd |
| Diffu-GRPO | 39 | Not recorded | 693a4ffd6cfd488761a549dd |
| wd1 | 39 | Not recorded | 693a4ffd6cfd488761a549dd |
| d-TreeRPO | 38.9 | Not recorded | 693a4ffd6cfd488761a549dd |
| GDPO | 38.5 | Not recorded | 693a4ffd6cfd488761a549dd |
| SAPO | 38.4 | Not recorded | 693a4ffd6cfd488761a549dd |
| LLaDA-8B-Instruct | 36.2 | Not recorded | 693a4ffd6cfd488761a549dd |
| VRPO (LLaDA-1.5) | 34.8 | Not recorded | 693a4ffd6cfd488761a549dd |

### d-TreeRPO

Pass@1 Accuracy: 46.3. Result ID: 6996c5175698665ec41088e7.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### TraceRL

Pass@1 Accuracy: 44.1. Result ID: 6996c5175698665ec41088e6.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b321e209131cea872db.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### Diffu-GRPO

Pass@1 Accuracy: 43.4. Result ID: 6996c5175698665ec41088e2.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79151e209131cea7c0c1.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### wd1

Pass@1 Accuracy: 43.4. Result ID: 6996c5175698665ec41088e3.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ff1e209131cea808cd.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### LLaDA-MoE-7BA1B-Instruct

Pass@1 Accuracy: 42.2. Result ID: 6996c5175698665ec41088e1.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb71e209131cea8a1be.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### GDPO

Pass@1 Accuracy: 41.2. Result ID: 6996c5175698665ec41088e5.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b981.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### SAPO

Pass@1 Accuracy: 40.4. Result ID: 6996c5175698665ec41088e4.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bd31e209131cea8abf1.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-MoE-7BA1B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### TraceRL

Pass@1 Accuracy: 39.1. Result ID: 6996c5175698665ec41088df.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b321e209131cea872db.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### Diffu-GRPO

Pass@1 Accuracy: 39. Result ID: 6996c5175698665ec41088da.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79151e209131cea7c0c1.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### wd1

Pass@1 Accuracy: 39. Result ID: 6996c5175698665ec41088dc.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ff1e209131cea808cd.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### d-TreeRPO

Pass@1 Accuracy: 38.9. Result ID: 6996c5175698665ec41088e0.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### GDPO

Pass@1 Accuracy: 38.5. Result ID: 6996c5175698665ec41088de.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b981.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### SAPO

Pass@1 Accuracy: 38.4. Result ID: 6996c5175698665ec41088dd.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bd31e209131cea8abf1.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### LLaDA-8B-Instruct

Pass@1 Accuracy: 36.2. Result ID: 6996c5175698665ec41088d9.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c3e1e209131cea8d1d9.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

### VRPO (LLaDA-1.5)

Pass@1 Accuracy: 34.8. Result ID: 6996c5175698665ec41088db.

[Reporting paper](<https://www.sota2.com/research/paper/693a4ffd6cfd488761a549dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c0e1e209131cea8c28e.md>)

Recorded evaluation configuration: {"Base Model":"LLaDA-8B-Instruct","Generation Length":512}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
