ResearchBenchmarksSparse Autoencoding on gemma2-2b layer-20 activationsFollow50L0 NormHSAE47.548.755051.25Feb 12, 2026Evaluation ResultsMethodMethodLinksL0 NormVariance ExplainedP(activ_p | activ_c)P(activ_c | activ_p)Hamming DistanceHSAESparsity level=L0 ~ 50Sparsity level=L0 ~ 502026.025072.98046.119.4BaselineSparsity level=L0 ~ 50Sparsity level=L0 ~ 502026.025072.772.939.530.6