SAE Interpretability and Faithfulness Evaluation on DINOv2 ViT-S 14 activations
6LLM RankDINOv2 ViT-S/14 (backbone only)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DINOv2 ViT-S/14 (backbone only)Backbone=DINOv2 ViT-S/142026.05 | 6 | 48.33 | 81.16 | 100 | |
| Archetypal SAEBackbone=DINOv2 ViT-S/142026.05 | 5 | 58.51 | 77.44 | 81.43 | |
| Matching PursuitBackbone=DINOv2 ViT-S/142026.05 | 4 | 70.55 | 79.25 | 90.26 | |
| BatchTopK-SAEBackbone=DINOv2 ViT-S/142026.05 | 3 | 68.08 | 78.69 | 87.24 | |
| Matryoshka SAEBackbone=DINOv2 ViT-S/142026.05 | 2 | 70.03 | 78.93 | 87.65 | |
| ELUDeBackbone=DINOv2 ViT-S/142026.05 | 1 | 73.31 | 81.15 | 100 |