# Sycophancy Evaluation on Sycophancy Evaluation Dataset Source: [Sycophancy Evaluation on Sycophancy Evaluation Dataset]() Collection index: [llms.txt]() Data updated: 2026-04-21T07:04:33.609Z Evaluation of model performance on the Sycophancy Evaluation Dataset, focusing on aggregated sycophancy scores categorized by 'Total', '3rd-P', and 'User' perspectives. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Sycophancy Evaluation | | Dataset (including any stated split) | Sycophancy Evaluation Dataset | | Metric | Total Sycophancy Score | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Total Sycophancy Score](): Lower is better; unit: SCALAR. - [Sycophancy Score (3rd-P)](): Lower is better; unit: SCALAR. - [Sycophancy Score (User)](): Lower is better; unit: SCALAR. ## Recorded results | Method | Total Sycophancy Score | Result date | Report paper | | --- | --- | --- | --- | | mistral:7b | 0.123 | Not recorded | 68fa7c421e209131cea8d346 | | claude-haiku-4-5 | 0.152 | Not recorded | 68fa7c421e209131cea8d346 | | claude-haiku-4-5 | 0.152 | Not recorded | 68fa7c421e209131cea8d346 | | mistral:7b | 0.171 | Not recorded | 68fa7c421e209131cea8d346 | | claude-haiku-4-5 | 0.176 | Not recorded | 68fa7c421e209131cea8d346 | | claude-haiku-4-5 | 0.176 | Not recorded | 68fa7c421e209131cea8d346 | | phi4:14b | 0.294 | Not recorded | 68fa7c421e209131cea8d346 | | phi4:14b | 0.315 | Not recorded | 68fa7c421e209131cea8d346 | | BayesDPO | 0.341 | Not recorded | 68fa7c421e209131cea8d346 | | BayesDPO | 0.344 | Not recorded | 68fa7c421e209131cea8d346 | | gpt-4o-mini | 0.398 | Not recorded | 68fa7c421e209131cea8d346 | | gpt-4o-mini | 0.402 | Not recorded | 68fa7c421e209131cea8d346 | | phi4:14b | 0.407 | Not recorded | 68fa7c421e209131cea8d346 | | phi4:14b | 0.429 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:3b | 0.445 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:3b | 0.448 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:1b | 0.489 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:1b | 0.505 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:3b | 0.545 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:3b | 0.551 | Not recorded | 68fa7c421e209131cea8d346 | | gpt-4o-mini | 0.558 | Not recorded | 68fa7c421e209131cea8d346 | | gpt-4o-mini | 0.558 | Not recorded | 68fa7c421e209131cea8d346 | | mistral:7b | 0.641 | Not recorded | 68fa7c421e209131cea8d346 | | mistral:7b | 0.651 | Not recorded | 68fa7c421e209131cea8d346 | | BayesDPO | 0.696 | Not recorded | 68fa7c421e209131cea8d346 | | BayesDPO | 0.696 | Not recorded | 68fa7c421e209131cea8d346 | | BayesSFT | 0.772 | Not recorded | 68fa7c421e209131cea8d346 | | BayesSFT | 0.774 | Not recorded | 68fa7c421e209131cea8d346 | | BayesSFT | 0.776 | Not recorded | 68fa7c421e209131cea8d346 | | BayesSFT | 0.787 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:1b | 1.15 | Not recorded | 68fa7c421e209131cea8d346 | | llama3.2:1b | 1.161 | Not recorded | 68fa7c421e209131cea8d346 | ### mistral:7b Total Sycophancy Score: 0.123. Result ID: 69e720a447f34ce924cccb06. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### claude-haiku-4-5 Total Sycophancy Score: 0.152. Result ID: 69e720a447f34ce924cccb0f. [Reporting paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### claude-haiku-4-5 Total Sycophancy Score: 0.152. Result ID: 69e720a447f34ce924cccb10. [Reporting paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### mistral:7b Total Sycophancy Score: 0.171. Result ID: 69e720a447f34ce924cccb05. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### claude-haiku-4-5 Total Sycophancy Score: 0.176. Result ID: 69e720a447f34ce924cccb11. [Reporting paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### claude-haiku-4-5 Total Sycophancy Score: 0.176. Result ID: 69e720a447f34ce924cccb12. [Reporting paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### phi4:14b Total Sycophancy Score: 0.294. Result ID: 69e720a447f34ce924cccb07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### phi4:14b Total Sycophancy Score: 0.315. Result ID: 69e720a447f34ce924cccb08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### BayesDPO Total Sycophancy Score: 0.341. Result ID: 69e720a447f34ce924cccb1e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### BayesDPO Total Sycophancy Score: 0.344. Result ID: 69e720a447f34ce924cccb1d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### gpt-4o-mini Total Sycophancy Score: 0.398. Result ID: 69e720a447f34ce924cccb0b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### gpt-4o-mini Total Sycophancy Score: 0.402. Result ID: 69e720a447f34ce924cccb0c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### phi4:14b Total Sycophancy Score: 0.407. Result ID: 69e720a447f34ce924cccb09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### phi4:14b Total Sycophancy Score: 0.429. Result ID: 69e720a447f34ce924cccb0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:3b Total Sycophancy Score: 0.445. Result ID: 69e720a447f34ce924cccb02. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:3b Total Sycophancy Score: 0.448. Result ID: 69e720a447f34ce924cccb01. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### llama3.2:1b Total Sycophancy Score: 0.489. Result ID: 69e720a447f34ce924cccb16. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:1b Total Sycophancy Score: 0.505. Result ID: 69e720a447f34ce924cccb15. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### llama3.2:3b Total Sycophancy Score: 0.545. Result ID: 69e720a447f34ce924cccb00. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:3b Total Sycophancy Score: 0.551. Result ID: 69e720a447f34ce924cccaff. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### gpt-4o-mini Total Sycophancy Score: 0.558. Result ID: 69e720a447f34ce924cccb0d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### gpt-4o-mini Total Sycophancy Score: 0.558. Result ID: 69e720a447f34ce924cccb0e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### mistral:7b Total Sycophancy Score: 0.641. Result ID: 69e720a447f34ce924cccb03. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### mistral:7b Total Sycophancy Score: 0.651. Result ID: 69e720a447f34ce924cccb04. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### BayesDPO Total Sycophancy Score: 0.696. Result ID: 69e720a447f34ce924cccb1b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### BayesDPO Total Sycophancy Score: 0.696. Result ID: 69e720a447f34ce924cccb1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### BayesSFT Total Sycophancy Score: 0.772. Result ID: 69e720a447f34ce924cccb1a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### BayesSFT Total Sycophancy Score: 0.774. Result ID: 69e720a447f34ce924cccb19. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing (Multiple Samples=5)","Calibration":"Raw"}. This record does not assert independent reproduction. ### BayesSFT Total Sycophancy Score: 0.776. Result ID: 69e720a447f34ce924cccb17. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. ### BayesSFT Total Sycophancy Score: 0.787. Result ID: 69e720a447f34ce924cccb18. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"llama3.2:1b","Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:1b Total Sycophancy Score: 1.15. Result ID: 69e720a447f34ce924cccb14. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Calibrated"}. This record does not assert independent reproduction. ### llama3.2:1b Total Sycophancy Score: 1.161. Result ID: 69e720a447f34ce924cccb13. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Elicitation Method":"Direct Probing","Calibration":"Raw"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.