# Reward rollout alignment on 10-task benchmark T1: Folding Shorts

Source: [Reward rollout alignment on 10-task benchmark T1: Folding Shorts](<https://www.sota2.com/research/sota/reward-rollout-alignment-on-10-task-benchmark-t1-folding-shorts>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T07:25:18.587Z

Evaluation of model performance on the Reward rollout alignment task using the 10-task benchmark T1: Folding Shorts dataset, measured by Rollout ρ.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Reward rollout alignment |
| Dataset (including any stated split) | 10-task benchmark T1: Folding Shorts |
| Metric | Rollout ρ |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Rollout ρ](<https://www.sota2.com/research/sota/reward-rollout-alignment-on-10-task-benchmark-t1-folding-shorts.md?metric=Rollout%20%CF%81>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Rollout ρ | Result date | Report paper |
| --- | --- | --- | --- |
| SARM2 | 0.889 | Not recorded | 6a28f31990966ade919c15d7 |
| SARM2 | 0.833 | Not recorded | 6a28f31990966ade919c15d7 |
| Robometer | 0.667 | Not recorded | 6a28f31990966ade919c15d7 |
| SARM2 | 0.611 | Not recorded | 6a28f31990966ade919c15d7 |
| SARM2 | 0.556 | Not recorded | 6a28f31990966ade919c15d7 |
| Robometer | 0.222 | Not recorded | 6a28f31990966ade919c15d7 |
| RW | 0.167 | Not recorded | 6a28f31990966ade919c15d7 |
| TR | -0.222 | Not recorded | 6a28f31990966ade919c15d7 |

### SARM2

Rollout ρ: 0.889. Result ID: 6a2a62d3fbc373592c271611.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

Recorded evaluation configuration: {"training\_subset":"S1"}. This record does not assert independent reproduction.

### SARM2

Rollout ρ: 0.833. Result ID: 6a2a62d3fbc373592c271612.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

Recorded evaluation configuration: {"standard\_full":"true"}. This record does not assert independent reproduction.

### Robometer

Rollout ρ: 0.667. Result ID: 6a2a62d3fbc373592c27160e.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a66c572d603e6de3e3d157.md>)

Recorded evaluation configuration: {"Fine-tuning":"true"}. This record does not assert independent reproduction.

### SARM2

Rollout ρ: 0.611. Result ID: 6a2a62d3fbc373592c271610.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

Recorded evaluation configuration: {"Multi-Goal":"excluded"}. This record does not assert independent reproduction.

### SARM2

Rollout ρ: 0.556. Result ID: 6a2a62d3fbc373592c27160f.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

Recorded evaluation configuration: {"Spectral Embedding":"excluded"}. This record does not assert independent reproduction.

### Robometer

Rollout ρ: 0.222. Result ID: 6a2a62d3fbc373592c27160d.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a66c572d603e6de3e3d157.md>)

Recorded evaluation configuration: {"Fine-tuning":"false"}. This record does not assert independent reproduction.

### RW

Rollout ρ: 0.167. Result ID: 6a2a62d3fbc373592c27160b.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b751e209131cea889e2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TR

Rollout ρ: -0.222. Result ID: 6a2a62d3fbc373592c27160c.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f31990966ade919c15d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30bf6017c4460ffab72c.md>)

[Implementation](<https://github.com/TOPReward/TOPReward>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
