Refusal Control on SORRY-Bench
70.45Refusal RateDEEPSEEK R1 DISTILL LLAMA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DEEPSEEK R1 DISTILL LLAMABackbone=DEEPSEEK R1 DISTILL LLAMA2026.03 | 70.45 | — | |
| Low-Rank CombinationBackbone=DEEPSEEK R1 DISTILL LLAMA, Method=Low-Rank Combination2026.03 | 70.91 | — | |
| LLAMA 3 8B INSTRUCTBackbone=LLAMA 3 8B INSTRUCT2026.03 | 77.27 | — | |
| Low-Rank CombinationBackbone=LLAMA 3 8B INSTRUCT, Method=Low-Rank Combination2026.03 | 78.86 | — | |
| REFUSE-LLAMABackbone=REFUSE-LLAMA2026.03 | 84.77 | — | |
| Low-Rank CombinationBackbone=REFUSE-LLAMA, Method=Low-Rank Combination2026.03 | 93.18 | — | |
| Categorical SteeringBackbone=REFUSE-LLAMA, Method=Categorical Steering2026.03 | 93.64 | — | |
| BaselineZero-shot=true2026.03 | — | 59.9 | |
| DIRECTERbeta=0.32026.03 | — | 63.8 | |
| DIRECTERbeta=0.52026.03 | — | 63.3 | |
| DIRECTERbeta=0.72026.03 | — | 62 |