SAE Interpretability and Faithfulness Evaluation on ConvNeXt Base activations V2
6LLM RankConvNeXtV2-Base (backbone only)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ConvNeXtV2-Base (backbone only)Backbone=ConvNeXtV2-Base2026.05 | 6 | 8.74 | 86.74 | 100 | |
| Archetypal SAEBackbone=ConvNeXtV2-Base2026.05 | 5 | 17.35 | 86.66 | 73.85 | |
| ELUDeBackbone=ConvNeXtV2-Base2026.05 | 4 | 32.66 | 86.74 | 100 | |
| Matryoshka SAEBackbone=ConvNeXtV2-Base2026.05 | 3 | 23.44 | 86.67 | 84.42 | |
| Matching PursuitBackbone=ConvNeXtV2-Base2026.05 | 2 | 30.43 | 86.69 | 84.03 | |
| BatchTopK-SAEBackbone=ConvNeXtV2-Base2026.05 | 1 | 25.65 | 86.7 | 84.77 |