SAE Interpretability and Faithfulness Evaluation on DINOv2 ViT-B 14 Layer 12 activations
6LLM RankDINOv2 ViT-B/14 layer 12 (backbone only) (EF4)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DINOv2 ViT-B/14 layer 12 (backbone only) (EF4)Backbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 6 | 36.2 | 84.3 | 100 | |
| DINOv2 ViT-B/14 layer 12 (backbone only) (EF16)Backbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 6 | 36.2 | 84.3 | 100 | |
| BatchTopK-SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 5 | 53.67 | 81.93 | 87.96 | |
| BatchTopK-SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 5 | 44.13 | 82.16 | 89.65 | |
| ELUDeBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 4 | 62.72 | 84.29 | 100 | |
| Matryoshka SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 4 | 47.48 | 82.15 | 89.38 | |
| Archetypal SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 3 | 61.98 | 81.03 | 83.65 | |
| Matching PursuitBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 3 | 55.35 | 83.03 | 91.37 | |
| Matching PursuitBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 2 | 58.4 | 82.51 | 88.77 | |
| Archetypal SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 2 | 43.03 | 81.32 | 85.26 | |
| Matryoshka SAEBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=42026.05 | 1 | 56.36 | 81.97 | 87.58 | |
| ELUDeBackbone=DINOv2 ViT-B/14, Layer=12, Expansion Factor=162026.05 | 1 | 67.48 | 84.29 | 100 |