Steering Detection on 121 concepts out-of-distribution suites (held-out)
95.5Detection RateQwen 2.5 32B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen 2.5 32BConfiguration=Adapted2025.11 | 95.5 | 71.2 | 0 | |
| QwQ 32BConfiguration=Adapted2025.11 | 94.8 | 70.8 | 0 | |
| Gemma 2 9BConfiguration=Adapted2025.11 | 90.8 | 78.2 | 0 | |
| Llama 3 70BConfiguration=Adapted2025.11 | 86.9 | 68.5 | 0 | |
| Qwen 2.5 7BConfiguration=Adapted2025.11 | 85.5 | 71.4 | 0 | |
| DeepSeek 7BConfiguration=Adapted2025.11 | 50 | 38.9 | 0 | |
| Llama 3 8BConfiguration=Adapted2025.11 | 43.3 | 29.1 | 0 | |
| Llama 3 8BConfiguration=Base2025.11 | 8.1 | — | — | |
| Qwen 2.5 32BConfiguration=Base2025.11 | 7.9 | — | — | |
| QwQ 32BConfiguration=Base2025.11 | 5.8 | — | — | |
| Llama 3 70BConfiguration=Base2025.11 | 1.7 | — | — | |
| Qwen 2.5 7BConfiguration=Base2025.11 | 0.6 | — | — | |
| Gemma 2 9BConfiguration=Base2025.11 | 0 | — | — | |
| DeepSeek 7BConfiguration=Base2025.11 | 0 | — | — |