# Sycophancy Evaluation Opinion

Source: [Sycophancy Evaluation Opinion](<https://www.sota2.com/research/sota/sycophancy-evaluation-opinion>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T08:07:14.139Z

Evaluation of model sycophancy using the Sycophancy Evaluation Opinion dataset, measured by PSS, CFS, PACF, and GAS metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Sycophancy Evaluation |
| Dataset (including any stated split) | Sycophancy Evaluation Opinion |
| Metric | PSS |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PSS](<https://www.sota2.com/research/sota/sycophancy-evaluation-opinion.md?metric=PSS>): Higher is better; unit: PERCENT.

- [CFS](<https://www.sota2.com/research/sota/sycophancy-evaluation-opinion.md?metric=CFS>): Higher is better; unit: PERCENT.

- [PACF](<https://www.sota2.com/research/sota/sycophancy-evaluation-opinion.md?metric=PACF>): Higher is better; unit: PERCENT.

- [GAS](<https://www.sota2.com/research/sota/sycophancy-evaluation-opinion.md?metric=GAS>): Higher is better; unit: PERCENT.

## Recorded results

| Method | PSS | Result date | Report paper |
| --- | --- | --- | --- |
| Mistral-7B | 8.14 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Llama-3.1 | 6.81 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Llama-3 | 6.51 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Gemma-2 | 6.28 | Not recorded | 69d5e12d7d0172140ec75bfc |
| DS-Math | 5.31 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Mistral-7B | 4.87 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Llama-3 | 4.12 | Not recorded | 69d5e12d7d0172140ec75bfc |
| DS-R1 | 4.03 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Gemma-2 | 3.91 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Qwen3 | 3.47 | Not recorded | 69d5e12d7d0172140ec75bfc |
| DS-Math | 3.14 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Llama-3.1 | 3.12 | Not recorded | 69d5e12d7d0172140ec75bfc |
| DS-R1 | 2.47 | Not recorded | 69d5e12d7d0172140ec75bfc |
| Qwen3 | 2.18 | Not recorded | 69d5e12d7d0172140ec75bfc |

### Mistral-7B

PSS: 8.14. Result ID: 69d60b8847f34ce924be6c90.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### Llama-3.1

PSS: 6.81. Result ID: 69d60b8847f34ce924be6c93.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### Llama-3

PSS: 6.51. Result ID: 69d60b8847f34ce924be6c92.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### Gemma-2

PSS: 6.28. Result ID: 69d60b8847f34ce924be6c8f.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### DS-Math

PSS: 5.31. Result ID: 69d60b8847f34ce924be6c8d.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### Mistral-7B

PSS: 4.87. Result ID: 69d60b8847f34ce924be6c97.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### Llama-3

PSS: 4.12. Result ID: 69d60b8847f34ce924be6c99.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### DS-R1

PSS: 4.03. Result ID: 69d60b8847f34ce924be6c8e.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### Gemma-2

PSS: 3.91. Result ID: 69d60b8847f34ce924be6c96.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### Qwen3

PSS: 3.47. Result ID: 69d60b8847f34ce924be6c91.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"Baseline"}. This record does not assert independent reproduction.

### DS-Math

PSS: 3.14. Result ID: 69d60b8847f34ce924be6c94.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### Llama-3.1

PSS: 3.12. Result ID: 69d60b8847f34ce924be6c9a.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### DS-R1

PSS: 2.47. Result ID: 69d60b8847f34ce924be6c95.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

### Qwen3

PSS: 2.18. Result ID: 69d60b8847f34ce924be6c98.

[Reporting paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d5e12d7d0172140ec75bfc.md>)

Recorded evaluation configuration: {"Training Strategy":"GRPO reward decomposition"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
