ResearchBenchmarksSparse Autoencoding on Pythia 70M (layer-3 residuals)For AI assistantsMarkdownContent indexSparse Autoencoding on Pythia 70M (layer-3 residuals)Follow33.9Achieved L0AEN-SAE15.28420.11724.9529.783May 6, 2026Evaluation resultsMethodMethodLinksAchieved L0Dead Neurons (%)Explained Variancep90 CoherenceMax CoherenceAEN-SAETarget l0=≈ 32Target l0=≈ 322026.0533.91.371.962.896.3TopKTarget l0=≈ 32Target l0=≈ 322026.053213.97632.998.9AEN-SAETarget l0=≈ 16Target l0=≈ 162026.0518.26.663.268.593.6TopKTarget l0=≈ 16Target l0=≈ 162026.05162.36832.698.6