# Mathematical Reasoning on AIME 2024 (Avg@10 Accuracy)

Source: [Mathematical Reasoning on AIME 2024 (Avg@10 Accuracy)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-aime-2024-avg-at-10-accuracy>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T11:05:59.229Z

Evaluation of model performance on the American Invitational Mathematics Examination (AIME) 2024 dataset, focusing on accuracy calculated using k=10 sampling.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Mathematical Reasoning |
| Dataset (including any stated split) | AIME 2024 |
| Metric | Avg@10 Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Avg@10 Accuracy](<https://www.sota2.com/research/sota/mathematical-reasoning-on-aime-2024-avg-at-10-accuracy.md?metric=Avg%4010%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Avg@10 Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| AsymGRPO | 39.33 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO w/ Entro.Regularization | 38.33 | Not recorded | 69d48fe67d0172140ec74782 |
| Dr.GRPO | 36.33 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO w/ Clip-higher | 34.67 | Not recorded | 69d48fe67d0172140ec74782 |
| AsymGRPO w/ Clip-higher | 33.67 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO w/ Entro.Adv | 32 | Not recorded | 69d48fe67d0172140ec74782 |
| AsymGRPO (βpos = βneg) | 32 | Not recorded | 69d48fe67d0172140ec74782 |
| GRPO | 31 | Not recorded | 69d48fe67d0172140ec74782 |
| REINFORCE | 28.67 | Not recorded | 69d48fe67d0172140ec74782 |
| Pass@K Training | 27.67 | Not recorded | 69d48fe67d0172140ec74782 |
| Pos-Only Modulation (§ 3.1) | 27.33 | Not recorded | 69d48fe67d0172140ec74782 |
| Neg-Only Modulation (§ 3.1) | 26 | Not recorded | 69d48fe67d0172140ec74782 |
| EntIncrease (§ 3.2) | 26 | Not recorded | 69d48fe67d0172140ec74782 |
| EntDecrease (§ 3.2) | 25 | Not recorded | 69d48fe67d0172140ec74782 |
| Qwen3-4B | 21.67 | Not recorded | 69d48fe67d0172140ec74782 |

### AsymGRPO

Avg@10 Accuracy: 39.33. Result ID: 69d4e51047f34ce924bd939c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO w/ Entro.Regularization

Avg@10 Accuracy: 38.33. Result ID: 69d4e51047f34ce924bd9392.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Dr.GRPO

Avg@10 Accuracy: 36.33. Result ID: 69d4e51047f34ce924bd9395.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7be51e209131cea8b201.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO w/ Clip-higher

Avg@10 Accuracy: 34.67. Result ID: 69d4e51047f34ce924bd9393.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a81e209131cea79ac6.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### AsymGRPO w/ Clip-higher

Avg@10 Accuracy: 33.67. Result ID: 69d4e51047f34ce924bd939d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO w/ Entro.Adv

Avg@10 Accuracy: 32. Result ID: 69d4e51047f34ce924bd9394.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a921e209131cea83f9d.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### AsymGRPO (βpos = βneg)

Avg@10 Accuracy: 32. Result ID: 69d4e51047f34ce924bd939b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### GRPO

Avg@10 Accuracy: 31. Result ID: 69d4e51047f34ce924bd9391.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### REINFORCE

Avg@10 Accuracy: 28.67. Result ID: 69d4e51047f34ce924bd9390.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Pass@K Training

Avg@10 Accuracy: 27.67. Result ID: 69d4e51047f34ce924bd9396.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7aad1e209131cea848da.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Pos-Only Modulation (§ 3.1)

Avg@10 Accuracy: 27.33. Result ID: 69d4e51047f34ce924bd9397.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Neg-Only Modulation (§ 3.1)

Avg@10 Accuracy: 26. Result ID: 69d4e51047f34ce924bd9398.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### EntIncrease (§ 3.2)

Avg@10 Accuracy: 26. Result ID: 69d4e51047f34ce924bd9399.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### EntDecrease (§ 3.2)

Avg@10 Accuracy: 25. Result ID: 69d4e51047f34ce924bd939a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

Recorded evaluation configuration: {"Base Model":"Qwen3-4B","Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

### Qwen3-4B

Avg@10 Accuracy: 21.67. Result ID: 69d4e51047f34ce924bd938f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fe67d0172140ec74782.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Temperature":"0.4","Top-p":"1.0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
