Sycophancy on FaithfulQA
87.58Sycophancy ScoreREP
Evaluation results
| Method | Links | |
|---|---|---|
| REPBackbone=Mistral-7B-Instruct-v0.12026.02 | 87.58 | |
| CAABackbone=Mistral-7B-Instruct-v0.12026.02 | 86.77 | |
| STEER2ADAPTBackbone=Mistral-7B-Instruct-v0.12026.02 | 84.68 | |
| STEER2ADAPTBackbone=Llama-3.1-8B-Instruct2026.02 | 84.29 | |
| ICLBackbone=Mistral-7B-Instruct-v0.12026.02 | 83.73 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=22026.02 | 82.44 | |
| Direct InferenceBackbone=Mistral-7B-Instruct-v0.12026.02 | 81.95 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=12026.02 | 79.49 | |
| REPBackbone=Llama-3.1-8B-Instruct2026.02 | 77.68 | |
| CAABackbone=Llama-3.1-8B-Instruct2026.02 | 75.37 | |
| Direct InferenceBackbone=Llama-3.1-8B-Instruct2026.02 | 72.64 | |
| ICLBackbone=Llama-3.1-8B-Instruct2026.02 | 71.7 | |
| CAABackbone=Qwen-2.5-7B-Instruct2026.02 | 68.38 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=22026.02 | 68.33 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=12026.02 | 67.99 | |
| STEER2ADAPTBackbone=Qwen-2.5-7B-Instruct2026.02 | 65.93 | |
| ICLBackbone=Qwen-2.5-7B-Instruct2026.02 | 64.25 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=12026.02 | 64.1 | |
| Direct InferenceBackbone=Qwen-2.5-7B-Instruct2026.02 | 62.66 | |
| REPBackbone=Qwen-2.5-7B-Instruct2026.02 | 62.27 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=22026.02 | 47.11 |