Attacker detection on Headline Detection Frontier
283.3Joint-Z Scorecross-family Qwen2.5-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| cross-family Qwen2.5-7BBackbone=Gemma-2-9B, SAE=Gemma-Scope-9B L20, 131k, Threshold (τ)=1.092026.04 | 283.3 | 260 | — | |
| white-box E-E (r=64)Backbone=Gemma-2-2B, SAE=Gemma-Scope L12, Threshold (τ)=1.092026.04 | 133.86 | 122.8 | — | |
| adaptive LoRA r=64Backbone=Gemma-2-2B, SAE=Gemma-Scope L12, Threshold (τ)=1.092026.04 | 105.89 | 97.2 | — | |
| adaptive LoRA r=64Backbone=Gemma-2-9B, SAE=Gemma-Scope-9B L20, 131k, Threshold (τ)=1.092026.04 | 43.7 | 40.1 | — | |
| adaptive LoRA r=128Backbone=Qwen3-1.7B, SAE=transcoder L14, Threshold (τ)=1.5092026.04 | 6.42 | 4.25 | — | |
| white-box E-E (r=64)Backbone=Qwen3-1.7B, SAE=transcoder L14, Threshold (τ)=1.5092026.04 | 4.99 | 3.31 | — | |
| adaptive LoRA r=64Backbone=Qwen3-1.7B, SAE=transcoder L14, Threshold (τ)=1.5092026.04 | 4.19 | 2.78 | — |