SAE Pareto Dominance Analysis on SmolLM3-3B activations
100Dominance FractionSA-half (SA-GSAE)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SA-half (SA-GSAE)Hookpoint=mlp_out, Overlap L0=[5.4, 127.4]2026.05 | 100 | 60 | 96 | 1.03 | 127.4 | |
| SA-half (SA-GSAE)Hookpoint=attn, Overlap L0=[4.8, 116.0]2026.05 | 66 | 2.2 | 2.1 | 3.1 | 50.3 | |
| SA-half (SA-GSAE)Hookpoint=resid, Overlap L0=[21.1, 111.9]2026.05 | 10 | 2 | 4 | 709 | 111.9 |