# Reinforcement Learning on HalfCheetah v4

Source: [Reinforcement Learning on HalfCheetah v4](<https://www.sota2.com/research/sota/reinforcement-learning-on-halfcheetah-v4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-24T07:29:51.231Z

Evaluation of Reinforcement Learning performance on the HalfCheetah v4 environment, typically measured by Max average return.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Reinforcement Learning |
| Dataset (including any stated split) | HalfCheetah v4 |
| Metric | Max Return |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Max Return](<https://www.sota2.com/research/sota/reinforcement-learning-on-halfcheetah-v4.md?metric=Max%20Return>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Max Return | Result date | Report paper |
| --- | --- | --- | --- |
| ReLU | 10554 | Not recorded | 697c3b66a8b01e76cc8da6e3 |
| C-DSAC | 10023 | Not recorded | 6a02b3dfdbc836b87d8244c0 |
| S-PLIF | 9828 | Not recorded | 697c3b66a8b01e76cc8da6e3 |
| S-PLIF | 9405 | Not recorded | 697c3b66a8b01e76cc8da6e3 |
| PLIF | 9252 | Not recorded | 697c3b66a8b01e76cc8da6e3 |
| PLIF | 9219 | Not recorded | 697c3b66a8b01e76cc8da6e3 |
| PDA | 5174.6 | Not recorded | 69b24870d030084c22e2f7c4 |
| TRPO | 4496.8 | Not recorded | 69b24870d030084c22e2f7c4 |
| PPO | 4067.5 | Not recorded | 69b24870d030084c22e2f7c4 |
| NPG | 3556.4 | Not recorded | 69b24870d030084c22e2f7c4 |
| Adaptive β | 2207 | Not recorded | 6a3b64b5206542251d7c9815 |
| Fixed β | 2111 | Not recorded | 6a3b64b5206542251d7c9815 |
| PPO-Clip | 1955 | Not recorded | 6a3b64b5206542251d7c9815 |
| per-sample PPO-KL | 1955 | Not recorded | 6a3b64b5206542251d7c9815 |

### ReLU

Max Return: 10554. Result ID: 6999ad3a5698665ec424f190.

[Reporting paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

Recorded evaluation configuration: {"Frame":"ANN"}. This record does not assert independent reproduction.

### C-DSAC

Max Return: 10023. Result ID: 6a02d51847f34ce924e53ba9.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b3dfdbc836b87d8244c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b3dfdbc836b87d8244c0.md>)

Recorded evaluation configuration: {"Number of runs":"100","Selection":"Best models in training runs"}. This record does not assert independent reproduction.

### S-PLIF

Max Return: 9828. Result ID: 6999ad3a5698665ec424f192.

[Reporting paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

Recorded evaluation configuration: {"Frame":"Vanilla"}. This record does not assert independent reproduction.

### S-PLIF

Max Return: 9405. Result ID: 6999ad3a5698665ec424f194.

[Reporting paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

Recorded evaluation configuration: {"Frame":"PT"}. This record does not assert independent reproduction.

### PLIF

Max Return: 9252. Result ID: 6999ad3a5698665ec424f191.

[Reporting paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a8c1e209131cea28b30.md>)

Recorded evaluation configuration: {"Frame":"Vanilla"}. This record does not assert independent reproduction.

### PLIF

Max Return: 9219. Result ID: 6999ad3a5698665ec424f193.

[Reporting paper](<https://www.sota2.com/research/paper/697c3b66a8b01e76cc8da6e3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a8c1e209131cea28b30.md>)

Recorded evaluation configuration: {"Frame":"PT"}. This record does not assert independent reproduction.

### PDA

Max Return: 5174.6. Result ID: 69b26c796dbb7075b95cafcc.

[Reporting paper](<https://www.sota2.com/research/paper/69b24870d030084c22e2f7c4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69b24870d030084c22e2f7c4.md>)

Recorded evaluation configuration: {"Environment steps":"1M","Number of seeds":"10","Tests per epoch":"10"}. This record does not assert independent reproduction.

### TRPO

Max Return: 4496.8. Result ID: 69b26c796dbb7075b95cafcb.

[Reporting paper](<https://www.sota2.com/research/paper/69b24870d030084c22e2f7c4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa634f1e209131ce9fe056.md>)

Recorded evaluation configuration: {"Environment steps":"1M","Number of seeds":"10","Tests per epoch":"10"}. This record does not assert independent reproduction.

### PPO

Max Return: 4067.5. Result ID: 69b26c796dbb7075b95cafca.

[Reporting paper](<https://www.sota2.com/research/paper/69b24870d030084c22e2f7c4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Environment steps":"1M","Number of seeds":"10","Tests per epoch":"10"}. This record does not assert independent reproduction.

### NPG

Max Return: 3556.4. Result ID: 69b26c796dbb7075b95cafc9.

[Reporting paper](<https://www.sota2.com/research/paper/69b24870d030084c22e2f7c4.md>)

Recorded evaluation configuration: {"Environment steps":"1M","Number of seeds":"10","Tests per epoch":"10"}. This record does not assert independent reproduction.

### Adaptive β

Max Return: 2207. Result ID: 6a3b8752fbc373592c439993.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b5206542251d7c9815.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Number of seeds":"5","Evaluation window":"last 10% of training"}. This record does not assert independent reproduction.

### Fixed β

Max Return: 2111. Result ID: 6a3b8752fbc373592c439992.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b5206542251d7c9815.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Number of seeds":"5","Evaluation window":"last 10% of training"}. This record does not assert independent reproduction.

### PPO-Clip

Max Return: 1955. Result ID: 6a3b8752fbc373592c439990.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b5206542251d7c9815.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Number of seeds":"5","Evaluation window":"last 10% of training"}. This record does not assert independent reproduction.

### per-sample PPO-KL

Max Return: 1955. Result ID: 6a3b8752fbc373592c439991.

[Reporting paper](<https://www.sota2.com/research/paper/6a3b64b5206542251d7c9815.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a3b64b5206542251d7c9815.md>)

Recorded evaluation configuration: {"Number of seeds":"5","Evaluation window":"last 10% of training"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
