# Mathematical Reasoning on MATH-500 (val)

Source: [Mathematical Reasoning on MATH-500 (val)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-math-500-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T11:05:59.200Z

Evaluation of model performance on the validation split of the MATH-500 dataset for mathematical reasoning, specifically measured using Avg@5 accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Mathematical Reasoning |
| Dataset (including any stated split) | MATH-500 (val) |
| Metric | Avg@5 Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Avg@5 Accuracy](<https://www.sota2.com/research/sota/mathematical-reasoning-on-math-500-val.md?metric=Avg%405%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Avg@5 Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| GRPO w/ Clip-higher | 90.07 | Not recorded | 69d48fe67d0172140ec74782 |
| AsymGRPO w/ Clip-higher | 89.73 | Not recorded | 69d48fe67d0172140ec74782 |
| AsymGRPO | 89.33 | Not recorded | 69d48fe67d0172140ec74782 |
| Dr.GRPO | 88.87 | Not recorded | 69d48fe67d0172140ec74782 |
| AsymGRPO (βpos = βneg) | 88.53 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO | 88.2 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO w/ Entro.Regularization | 88.2 | Not recorded | 69d48fe67d0172140ec74782 |
| Pos-Only Modulation (§ 3.1) | 87.13 | Not recorded | 69d48fe67d0172140ec74782 |
| Neg-Only Modulation (§ 3.1) | 87 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO w/ Entro.Adv | 86.73 | Not recorded | 69d48fe67d0172140ec74782 |
| REINFORCE | 86.6 | Not recorded | 69d48fe67d0172140ec74782 |
| Pass@K Training | 86.33 | Not recorded | 69d48fe67d0172140ec74782 |
| EntIncrease (§ 3.2) | 85.6 | Not recorded | 69d48fe67d0172140ec74782 |
| EntDecrease (§ 3.2) | 83.73 | Not recorded | 69d48fe67d0172140ec74782 |
| Qwen3-4B | 81.6 | Not recorded | 69d48fe67d0172140ec74782 |

### GRPO w/ Clip-higher

Avg@5 Accuracy: 90.07. Result ID: 69d4e51047f34ce924bd9384.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### AsymGRPO w/ Clip-higher

Avg@5 Accuracy: 89.73. Result ID: 69d4e51047f34ce924bd938e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### AsymGRPO

Avg@5 Accuracy: 89.33. Result ID: 69d4e51047f34ce924bd938d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Dr.GRPO

Avg@5 Accuracy: 88.87. Result ID: 69d4e51047f34ce924bd9386.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be51e209131cea8b201.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### AsymGRPO (βpos = βneg)

Avg@5 Accuracy: 88.53. Result ID: 69d4e51047f34ce924bd938c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO

Avg@5 Accuracy: 88.2. Result ID: 69d4e51047f34ce924bd9382.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO w/ Entro.Regularization

Avg@5 Accuracy: 88.2. Result ID: 69d4e51047f34ce924bd9383.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Pos-Only Modulation (§ 3.1)

Avg@5 Accuracy: 87.13. Result ID: 69d4e51047f34ce924bd9388.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Neg-Only Modulation (§ 3.1)

Avg@5 Accuracy: 87. Result ID: 69d4e51047f34ce924bd9389.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO w/ Entro.Adv

Avg@5 Accuracy: 86.73. Result ID: 69d4e51047f34ce924bd9385.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a921e209131cea83f9d.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### REINFORCE

Avg@5 Accuracy: 86.6. Result ID: 69d4e51047f34ce924bd9381.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Pass@K Training

Avg@5 Accuracy: 86.33. Result ID: 69d4e51047f34ce924bd9387.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7aad1e209131cea848da.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### EntIncrease (§ 3.2)

Avg@5 Accuracy: 85.6. Result ID: 69d4e51047f34ce924bd938a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### EntDecrease (§ 3.2)

Avg@5 Accuracy: 83.73. Result ID: 69d4e51047f34ce924bd938b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Qwen3-4B

Avg@5 Accuracy: 81.6. Result ID: 69d4e51047f34ce924bd9380.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
