Deception Detection on Agentic Misalignment
92.4AUROCSTATEWITNESS
Evaluation results
| Method | Links | |
|---|---|---|
| STATEWITNESSTarget Model=GPT-OSS-20B2026.06 | 92.4 | |
| STATEWITNESSTarget Model=GEMMA4-26B-A4B-IT2026.06 | 89.7 | |
| LLM-as-a-JudgeTarget Model=GPT-OSS-20B2026.06 | 88.5 | |
| LLM-as-a-JudgeTarget Model=GEMMA4-26B-A4B-IT2026.06 | 74.5 | |
| LLM-as-a-Judge w/ CoTTarget Model=GEMMA4-26B-A4B-IT2026.06 | 74 | |
| LLM-as-a-Judge w/ CoTTarget Model=GPT-OSS-20B2026.06 | 71.5 | |
| CMMS probeTarget Model=GPT-OSS-20B2026.06 | 69.9 | |
| LR probeTarget Model=GPT-OSS-20B2026.06 | 68.6 | |
| LAT probeTarget Model=GPT-OSS-20B2026.06 | 62.5 | |
| Self-EvaluationTarget Model=GEMMA4-26B-A4B-IT2026.06 | 60.5 | |
| LR probeTarget Model=GEMMA4-26B-A4B-IT2026.06 | 46.1 | |
| MMS probeTarget Model=GEMMA4-26B-A4B-IT2026.06 | 40.8 | |
| Self-EvaluationTarget Model=GPT-OSS-20B2026.06 | 39.9 | |
| MMS probeTarget Model=GPT-OSS-20B2026.06 | 35.6 | |
| LAT probeTarget Model=GEMMA4-26B-A4B-IT2026.06 | 30.5 | |
| CMMS probeTarget Model=GEMMA4-26B-A4B-IT2026.06 | 23 |