Sycophancy Detection on Anthropic Sycophancy Dataset
98.3AccuracyContrastive + LR
Evaluation results
| Method | Links | |
|---|---|---|
| Contrastive + LRApproach=Linear Probing (Baselines)2026.06 | 98.3 | |
| CLiF + SVMApproach=Linear Probing (Ours), Config=All2026.06 | 98.3 | |
| CLiF + LRApproach=Linear Probing (Ours), Config=All2026.06 | 96.7 | |
| CLiF + LRApproach=Linear Probing (Ours), Config=Level 22026.06 | 93.6 | |
| CLiF + SVMApproach=Linear Probing (Ours), Config=Level 22026.06 | 93.6 | |
| CLiF + LRApproach=Linear Probing (Ours), Config=Level 32026.06 | 93.5 | |
| CLiF + LRApproach=Linear Probing (Ours), Config=Level 12026.06 | 93.2 | |
| CLiF + SVMApproach=Linear Probing (Ours), Config=Level 32026.06 | 91.5 | |
| Contrastive + SVMApproach=Linear Probing (Baselines)2026.06 | 90 | |
| CLiF + SVMApproach=Linear Probing (Ours), Config=Level 12026.06 | 89.8 | |
| Gemini 2.5 ProApproach=LLM as a Judge (Baselines), Config=+ Examples2026.06 | 63.9 | |
| Gemini 2.5 ProApproach=LLM as a Judge (Baselines), Config=Default2026.06 | 60 | |
| Gemini 2.5 FlashApproach=LLM as a Judge (Baselines), Config=+ Examples2026.06 | 54.8 | |
| Gemini 2.5 FlashApproach=LLM as a Judge (Baselines), Config=Default2026.06 | 53.9 |