List your company

Directional Jailbreak Detection on UltraChat (Safe) × StrongREJECT (Harmful)

0.797AUROC (mono)Qwen3-8B
0.700280.725390.75050.77561Jun 23, 2026

Evaluation results

MethodLinks
Qwen3-8BProbe Layer=L25, Relative Depth=~69%, Total Layers=36, Direction=downward2026.060.7970.5410.543
Llama-3.1-8BProbe Layer=L22, Relative Depth=~69%, Total Layers=32, Direction=downward2026.060.790.7130.715
Gemma-7bProbe Layer=L19, Relative Depth=~68%, Total Layers=28, Direction=upward2026.060.7040.6430.643