Sycophancy
Benchmarks
TaskDatasetSOTA resultTrendResults
Sycophancy (test)
99Sycophancy Score (Test)
10
Sycophancy
51Mean Improvement
9
Sycophancy dataset knows-truth
74AUROC
9
Sycophancy
36.2Sycophancy
8
Sycophancy dataset
75.5Behavioral Alignment Score (Baseline)
6
Sycophancy
89.77CoT Plan Accuracy
6
SYCOPHANCY
0.983Mean MCC
6
Sycophancy
1MCC
6
Sycophancy (Held-out Bias)
100BRR Ratio
5
Sycophancy Bloom behaviors (in-distribution)
93.5AUROC
4