Interpretability and Faithfulness Evaluation on ImageNet 21k ViT-B/16 tokens
1LLM RankELUDe
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ELUDeBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 1 | 71.05 | 85.1 | 100 | |
| Archetypal SAEBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 2 | 59.15 | 84.88 | 79.76 | |
| Matching PursuitBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 3 | 56.91 | 85.03 | 89.66 | |
| TopK-SAEBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 4 | 54.49 | 84.94 | 87 | |
| Matryoshka SAEBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 5 | 51.16 | 85 | 86.85 | |
| BatchTopK-SAEBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 6 | 53.56 | 84.97 | 87.76 | |
| Vanilla SAEBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 7 | 54.55 | 85.01 | 91.65 | |
| Backbone onlyBackbone=ImageNet-21k ViT-B/162026.05 | 8 | 36.42 | 85.1 | 100 | |
| TranscoderBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 9 | 46.31 | 85.05 | 93.54 | |
| JumpReLUBackbone=ImageNet-21k ViT-B/16, Expansion factor=82026.05 | 10 | 31.82 | 85.1 | 99.99 |