Sparse Autoencoder Evaluation on Qwen3-8B layer 20
0.9889KL ScoreBatch TopK
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Batch TopKlayer=20, k=1002026.06 | 0.9889 | 0.922 | 0.2677 | 0.0074 | 1.1154 | |
| Ortlayer=20, k=1002026.06 | 0.9886 | 0.9214 | 0.0945 | 0.0034 | 1.1154 | |
| C²Rlayer=20, k=1002026.06 | 0.9874 | 0.9333 | 0.0675 | 0.0018 | 1.1154 | |
| Matryoshkalayer=20, k=1002026.06 | 0.987 | 0.9277 | 0.1422 | 0.0032 | 1.1154 |