ResearchBenchmarksSparse Autoencoding on qwen3-4b layer-18 activationsFollow50L0 NormBaseline49.99250.04650.150.154Feb 12, 2026Evaluation ResultsMethodMethodLinksL0 NormVariance ExplainedP(activ_p | activ_c)P(activ_c | activ_p)Hamming DistanceBaselineSparsity level=L0 ~ 50Sparsity level=L0 ~ 502026.025098.830.917.946.4HSAESparsity level=L0 ~ 50Sparsity level=L0 ~ 502026.0250.298.834.719.728.7