Sycophancy Mitigation on TruthfulQA
25Sycophancy RateLinear Probe MHA
Evaluation results
| Method | Links | |
|---|---|---|
| Linear Probe MHAModel=Llama 3.2, Intervention Type=MHA Steering2026.01 | 25 | |
| Linear Probe MHAModel=Gemma-3, Intervention Type=MHA Steering2026.01 | 34.4 | |
| System PromptModel=Llama 3.22026.01 | 37.5 | |
| BaseModel=Gemma-32026.01 | 40.7 | |
| System PromptModel=Gemma-32026.01 | 40.7 | |
| Linear Probe ResidualModel=Gemma-32026.01 | 41.2 | |
| Random Direction MLPModel=Gemma-32026.01 | 42.6 | |
| Random Direction MHAModel=Llama 3.22026.01 | 42.7 | |
| Linear Probe MLPModel=Gemma-32026.01 | 43.9 | |
| Linear Probe ResidualModel=Llama 3.22026.01 | 44.2 | |
| Linear Probe MLPModel=Llama 3.22026.01 | 44.4 | |
| Random Direction MLPModel=Llama 3.22026.01 | 44.7 | |
| Random Direction MHAModel=Gemma-32026.01 | 45.1 | |
| BaseModel=Llama 3.22026.01 | 51.7 |