SAE Feature Attribution on Gemma-3-4B 16K SAE
14.7Input Success RateQuery Lens
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Query LensTarget Component=Key2026.05 | 14.7 | 2.02 | |
| Token Changealpha=102026.05 | 11.28 | 6.37 | |
| Query LensTarget Component=Value2026.05 | 11.12 | 6.99 | |
| Token Changealpha=52026.05 | 10.9 | 5.99 | |
| Zero-Out2026.05 | 9.9 | 4.8 | |
| Token Changealpha=12026.05 | 6.42 | 2.97 | |
| Token Likelihood2026.05 | 2.94 | 6.04 | |
| Logit LensTarget Component=Value2026.05 | 2.84 | 6.08 | |
| Logit LensTarget Component=Key2026.05 | 2.57 | 5.2 |