Downstream Utility Evaluation on LLM Activations
87.9Sparse Probing AccuracyBaseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineDictionary Size=40962026.02 | 87.9 | |
| HSAEDictionary Size=81922026.02 | 87.4 | |
| HSAEDictionary Size=40962026.02 | 87.3 | |
| HSAEDictionary Size=163842026.02 | 87.3 | |
| HSAEDictionary Size=20482026.02 | 86.8 | |
| BaselineDictionary Size=20482026.02 | 86.3 | |
| BaselineDictionary Size=81922026.02 | 86.2 | |
| BaselineDictionary Size=163842026.02 | 85.5 |