# Sycophancy Evaluation on MIST Science

Source: [Sycophancy Evaluation on MIST Science](<https://www.sota2.com/research/sota/sycophancy-evaluation-on-mist-science>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T08:50:01.757Z

Evaluation of model sycophancy performance using the MIST Science dataset, focusing on Accuracy, Sycophancy rate, and Abandonment metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Sycophancy Evaluation |
| Dataset (including any stated split) | MIST Science |
| Metric | Sycophancy Rate |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 24 of 24 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Sycophancy Rate](<https://www.sota2.com/research/sota/sycophancy-evaluation-on-mist-science.md?metric=Sycophancy%20Rate>): Lower is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/sycophancy-evaluation-on-mist-science.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Abandonment Rate](<https://www.sota2.com/research/sota/sycophancy-evaluation-on-mist-science.md?metric=Abandonment%20Rate>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Sycophancy Rate | Result date | Report paper |
| --- | --- | --- | --- |
| Summarization | 4.7 | Not recorded | 6a28f38290966ade919c1a78 |
| GPT-5.2 | 4.9 | Not recorded | 6a28f38290966ade919c1a78 |
| Assistant Role Inclusion | 5.6 | Not recorded | 6a28f38290966ade919c1a78 |
| Anti-Sycophancy Prompting | 5.8 | Not recorded | 6a28f38290966ade919c1a78 |
| Sonnet 4.6 | 6.1 | Not recorded | 6a28f38290966ade919c1a78 |
| GPT-5.2 | 6.4 | Not recorded | 6a28f38290966ade919c1a78 |
| Kimi K2.5 | 6.5 | Not recorded | 6a28f38290966ade919c1a78 |
| Sonnet 4.6 | 7.1 | Not recorded | 6a28f38290966ade919c1a78 |
| Qwen 3.5 | 7.1 | Not recorded | 6a28f38290966ade919c1a78 |
| GPT-5.2 | 7.4 | Not recorded | 6a28f38290966ade919c1a78 |
| Mem0 | 7.8 | Not recorded | 6a28f38290966ade919c1a78 |
| GPT-5.2 | 7.8 | Not recorded | 6a28f38290966ade919c1a78 |
| MiniMax 2.5 | 8.5 | Not recorded | 6a28f38290966ade919c1a78 |
| MiniMax 2.5 | 9.1 | Not recorded | 6a28f38290966ade919c1a78 |
| Sonnet 4.6 | 9.2 | Not recorded | 6a28f38290966ade919c1a78 |
| MiniMax 2.5 | 10 | Not recorded | 6a28f38290966ade919c1a78 |
| Sonnet 4.6 | 10.2 | Not recorded | 6a28f38290966ade919c1a78 |
| Kimi K2.5 | 10.2 | Not recorded | 6a28f38290966ade919c1a78 |
| MiniMax 2.5 | 10.7 | Not recorded | 6a28f38290966ade919c1a78 |
| Kimi K2.5 | 11.5 | Not recorded | 6a28f38290966ade919c1a78 |
| Kimi K2.5 | 12.4 | Not recorded | 6a28f38290966ade919c1a78 |
| Qwen 3.5 | 13.7 | Not recorded | 6a28f38290966ade919c1a78 |
| Qwen 3.5 | 14.2 | Not recorded | 6a28f38290966ade919c1a78 |
| Qwen 3.5 | 17.9 | Not recorded | 6a28f38290966ade919c1a78 |

### Summarization

Sycophancy Rate: 4.7. Result ID: 6a2a76b8fbc373592c27afa8.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Strategy":"Summarize"}. This record does not assert independent reproduction.

### GPT-5.2

Sycophancy Rate: 4.9. Result ID: 6a2a76b8fbc373592c27afb1.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Chat History"}. This record does not assert independent reproduction.

### Assistant Role Inclusion

Sycophancy Rate: 5.6. Result ID: 6a2a76b8fbc373592c27afa7.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Strategy":"Asst. Role"}. This record does not assert independent reproduction.

### Anti-Sycophancy Prompting

Sycophancy Rate: 5.8. Result ID: 6a2a76b8fbc373592c27afa6.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Strategy":"Prompting"}. This record does not assert independent reproduction.

### Sonnet 4.6

Sycophancy Rate: 6.1. Result ID: 6a2a76b8fbc373592c27afb5.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Chat History"}. This record does not assert independent reproduction.

### GPT-5.2

Sycophancy Rate: 6.4. Result ID: 6a2a76b8fbc373592c27afb3.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"MemOS"}. This record does not assert independent reproduction.

### Kimi K2.5

Sycophancy Rate: 6.5. Result ID: 6a2a76b8fbc373592c27afbd.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Chat History"}. This record does not assert independent reproduction.

### Sonnet 4.6

Sycophancy Rate: 7.1. Result ID: 6a2a76b8fbc373592c27afb7.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"MemOS"}. This record does not assert independent reproduction.

### Qwen 3.5

Sycophancy Rate: 7.1. Result ID: 6a2a76b8fbc373592c27afb9.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Chat History"}. This record does not assert independent reproduction.

### GPT-5.2

Sycophancy Rate: 7.4. Result ID: 6a2a76b8fbc373592c27afb4.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Zep"}. This record does not assert independent reproduction.

### Mem0

Sycophancy Rate: 7.8. Result ID: 6a2a76b8fbc373592c27afa5.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa784b1e209131cea77ad6.md>)

Recorded evaluation configuration: {"Strategy":"Baseline"}. This record does not assert independent reproduction.

### GPT-5.2

Sycophancy Rate: 7.8. Result ID: 6a2a76b8fbc373592c27afb2.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Mem0"}. This record does not assert independent reproduction.

### MiniMax 2.5

Sycophancy Rate: 8.5. Result ID: 6a2a76b8fbc373592c27afc3.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"MemOS"}. This record does not assert independent reproduction.

### MiniMax 2.5

Sycophancy Rate: 9.1. Result ID: 6a2a76b8fbc373592c27afc1.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Chat History"}. This record does not assert independent reproduction.

### Sonnet 4.6

Sycophancy Rate: 9.2. Result ID: 6a2a76b8fbc373592c27afb8.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Zep"}. This record does not assert independent reproduction.

### MiniMax 2.5

Sycophancy Rate: 10. Result ID: 6a2a76b8fbc373592c27afc2.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Mem0"}. This record does not assert independent reproduction.

### Sonnet 4.6

Sycophancy Rate: 10.2. Result ID: 6a2a76b8fbc373592c27afb6.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Mem0"}. This record does not assert independent reproduction.

### Kimi K2.5

Sycophancy Rate: 10.2. Result ID: 6a2a76b8fbc373592c27afbf.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"MemOS"}. This record does not assert independent reproduction.

### MiniMax 2.5

Sycophancy Rate: 10.7. Result ID: 6a2a76b8fbc373592c27afc4.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Zep"}. This record does not assert independent reproduction.

### Kimi K2.5

Sycophancy Rate: 11.5. Result ID: 6a2a76b8fbc373592c27afbe.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Mem0"}. This record does not assert independent reproduction.

### Kimi K2.5

Sycophancy Rate: 12.4. Result ID: 6a2a76b8fbc373592c27afc0.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Zep"}. This record does not assert independent reproduction.

### Qwen 3.5

Sycophancy Rate: 13.7. Result ID: 6a2a76b8fbc373592c27afbc.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Zep"}. This record does not assert independent reproduction.

### Qwen 3.5

Sycophancy Rate: 14.2. Result ID: 6a2a76b8fbc373592c27afbb.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"MemOS"}. This record does not assert independent reproduction.

### Qwen 3.5

Sycophancy Rate: 17.9. Result ID: 6a2a76b8fbc373592c27afba.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a78.md>)

Recorded evaluation configuration: {"Memory System":"Mem0"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
