Sparse Autoencoder Quality Evaluation on The Pile Gemma-2-2B (test)
0.9618KL ScoreC2R
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| C2RBackbone=Gemma-2-2B, Layer=12, k=1002026.06 | 0.9618 | 0.9424 | 0.0766 | 0.0396 | 1.0385 | |
| OrtBackbone=Gemma-2-2B, Layer=12, k=1002026.06 | 0.9611 | 0.9202 | 0.1053 | 0.0627 | 1.0769 | |
| Batch TopKBackbone=Gemma-2-2B, Layer=12, k=1002026.06 | 0.9606 | 0.9211 | 0.3227 | 0.192 | 1.1538 | |
| MatryoshkaBackbone=Gemma-2-2B, Layer=12, k=1002026.06 | 0.9602 | 0.9117 | 0.1781 | 0.0158 | 1.0385 |