Hierarchical Feature Alignment on LLM Activations
98.8AbsorptionBaseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BaselineDictionary Size=20482026.02 | 98.8 | 53.9 | |
| HSAEDictionary Size=20482026.02 | 98.3 | 52.1 | |
| HSAEDictionary Size=40962026.02 | 98.1 | 58.2 | |
| BaselineDictionary Size=40962026.02 | 97.4 | 60.9 | |
| HSAEDictionary Size=81922026.02 | 95.1 | 62.7 | |
| HSAEDictionary Size=163842026.02 | 92.2 | 65.4 | |
| BaselineDictionary Size=81922026.02 | 90.1 | 62.7 | |
| BaselineDictionary Size=163842026.02 | 84.4 | 66.1 |