Sparse Reconstruction on LLM Activations
49.4L0HSAE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HSAEDictionary Size=20482026.02 | 49.4 | 61.2 | |
| BaselineDictionary Size=20482026.02 | 49.4 | 61.3 | |
| BaselineDictionary Size=40962026.02 | 49.8 | 65.1 | |
| HSAEDictionary Size=40962026.02 | 50 | 65.1 | |
| BaselineDictionary Size=81922026.02 | 50.3 | 68.4 | |
| HSAEDictionary Size=81922026.02 | 50.5 | 68.5 | |
| HSAEDictionary Size=163842026.02 | 50.6 | 71 | |
| BaselineDictionary Size=163842026.02 | 50.7 | 71.2 |