ResearchBenchmarksInterpreting Sparse Key-Value Features on Gemma 1B 3Interpreting Sparse Key-Value Features on Gemma 1B 3Follow14.14Input Success RateQL_KEY0.48484.02997.57511.1201May 30, 2026Evaluation resultsMethodMethodLinksInput Success RateOutput Success RateQL_KEY2026.0514.141.45TCa=10a=102026.059.318.37TCa=5a=52026.059.258.09TCa=1a=12026.058.976.45QL_VALUE2026.058.619.26ZO2026.054.243.13LLKEY2026.051.743.25LLVALUE2026.051.037.84TL2026.051.017.81