ResearchBenchmarksSparse Key-Value Feature Interpretation on Qwen-3-4BFollow11.08Input Success RateQL_KEY0.13922.97965.828.6604May 30, 2026Evaluation ResultsMethodMethodLinksInput Success RateOutput Success RateQL_KEYType=KeyType=Key2026.0511.080.04LL_KEYType=KeyType=Key2026.055.230.29TCalpha=10alpha=102026.052.697.16TCalpha=5alpha=52026.052.037.48TCalpha=1alpha=12026.051.657.36QL_VALUEType=ValueType=Value2026.051.366.93TL2026.050.821.24ZO2026.050.790.36LL_VALUEType=ValueType=Value2026.050.561.32