# Steering Success Rate on PopQA 150 questions

Source: [Steering Success Rate on PopQA 150 questions](<https://www.sota2.com/research/sota/steering-success-rate-on-popqa-150-questions>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-06T06:38:13.184Z

Evaluation of model performance on the PopQA 150 questions dataset, specifically measuring Steering Success Rate (Base SR, Adapted SR, and Delta).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Steering Success Rate |
| Dataset (including any stated split) | PopQA 150 questions |
| Metric | Base SR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Base SR](<https://www.sota2.com/research/sota/steering-success-rate-on-popqa-150-questions.md?metric=Base%20SR>): Higher is better; unit: PERCENT.

- [Adapted SR](<https://www.sota2.com/research/sota/steering-success-rate-on-popqa-150-questions.md?metric=Adapted%20SR>): Higher is better; unit: PERCENT.

- [Delta SR](<https://www.sota2.com/research/sota/steering-success-rate-on-popqa-150-questions.md?metric=Delta%20SR>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Base SR | Result date | Report paper |
| --- | --- | --- | --- |
| DeepSeek 7B | 33 | Not recorded | 6927db45d6b0dd3342930e7e |
| Llama 3 8B | 33 | Not recorded | 6927db45d6b0dd3342930e7e |
| Qwen 2.5 7B | 24.2 | Not recorded | 6927db45d6b0dd3342930e7e |
| Qwen 2.5 32B | 21.2 | Not recorded | 6927db45d6b0dd3342930e7e |
| Gemma 2 9B | 14.1 | Not recorded | 6927db45d6b0dd3342930e7e |

### DeepSeek 7B

Base SR: 33. Result ID: 69aa750e6dbb7075b9539c6a.

[Reporting paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

Recorded evaluation configuration: {"Model":"DeepSeek 7B"}. This record does not assert independent reproduction.

### Llama 3 8B

Base SR: 33. Result ID: 69aa750e6dbb7075b9539c6b.

[Reporting paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

Recorded evaluation configuration: {"Model":"Llama 3 8B"}. This record does not assert independent reproduction.

### Qwen 2.5 7B

Base SR: 24.2. Result ID: 69aa750e6dbb7075b9539c6c.

[Reporting paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

Recorded evaluation configuration: {"Model":"Qwen 2.5 7B"}. This record does not assert independent reproduction.

### Qwen 2.5 32B

Base SR: 21.2. Result ID: 69aa750e6dbb7075b9539c69.

[Reporting paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

Recorded evaluation configuration: {"Model":"Qwen 2.5 32B"}. This record does not assert independent reproduction.

### Gemma 2 9B

Base SR: 14.1. Result ID: 69aa750e6dbb7075b9539c68.

[Reporting paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db45d6b0dd3342930e7e.md>)

Recorded evaluation configuration: {"Model":"Gemma 2 9B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
