Safety refusal alignment on Held-out Safety Probes (test)
0.438Delta RefusalProcess sidecars
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Process sidecarsModel=Qwen-2.5-0.5B-Instruct, n=202026.06 | 0.438 | 0.383 | 20 | -0.024 | |
| Process sidecarsModel=Qwen-2.5-1.5B-Instruct, n=202026.06 | 0.347 | 0.273 | 20 | 0.009 | |
| Process sidecarsModel=Llama-3.2-1B-Instruct, n=202026.06 | 0.334 | 0.289 | 20 | 0.034 | |
| Process sidecarsModel=Qwen3.5-9B scale probe, n=112026.06 | 0.283 | 0.174 | 11 | 0.005 |