Interpreting Sparse Key-Value Features on Qwen 1.7B 3
21.69Input Success Rate (%)QL_KEY
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QL_KEY2026.05 | 21.69 | 0.55 | |
| QL_KEYType=Key2026.05 | 14.55 | 0.01 | |
| TCa=12026.05 | 14.46 | 8.13 | |
| TCa=52026.05 | 14.45 | 8.77 | |
| TCa=102026.05 | 14.23 | 8.89 | |
| ZO2026.05 | 12.55 | 6.21 | |
| QL_VALUE2026.05 | 11.65 | 9.36 | |
| TL2026.05 | 3.61 | 8.14 | |
| LLVALUE2026.05 | 3.56 | 8.31 | |
| TCalpha=52026.05 | 2.85 | 3.11 | |
| TCalpha=12026.05 | 2.81 | 3.12 | |
| ZO2026.05 | 2.75 | 0.17 | |
| TCalpha=102026.05 | 2.75 | 2.91 | |
| LLKEY2026.05 | 1.91 | 4.43 | |
| QL_VALUEType=Value2026.05 | 1.51 | 4.58 | |
| TL2026.05 | 0.66 | 1.75 | |
| LL_KEYType=Key2026.05 | 0.65 | 0.13 | |
| LL_VALUEType=Value2026.05 | 0.19 | 1.77 |