Input-based feature description evaluation on Gemma-2 Residual SAE features
67Feature Description ScoreEnsemble Raw
Evaluation Results
| Method | Links | |
|---|---|---|
| Ensemble Rawcombination=MA+TC2025.01 | 67 | |
| Ensemble Rawcombination=MA+VP2025.01 | 66.9 | |
| Ensemble Rawcombination=All2025.01 | 66.6 | |
| Ensemble Concatcombination=All2025.01 | 57.7 | |
| MaxAct2025.01 | 56.6 | |
| Ensemble Rawcombination=VP+TC2025.01 | 53.1 | |
| VocabProj2025.01 | 50.1 | |
| TokenChange2025.01 | 44.7 |