SAE Interpretability and Faithfulness Evaluation on DINOv2 ViT-L/14 activations
6LLM RankDINOv2 ViT-L/14 (backbone only)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DINOv2 ViT-L/14 (backbone only)Backbone=DINOv2 ViT-L/142026.05 | 6 | 30.06 | 86.12 | 100 | |
| Matching PursuitBackbone=DINOv2 ViT-L/142026.05 | 5 | 61.41 | 84.96 | 83.1 | |
| BatchTopK-SAEBackbone=DINOv2 ViT-L/142026.05 | 4 | 56.98 | 84.48 | 81.28 | |
| ELUDeBackbone=DINOv2 ViT-L/142026.05 | 3 | 65.88 | 86.12 | 100 | |
| Archetypal SAEBackbone=DINOv2 ViT-L/142026.05 | 2 | 60.04 | 83.81 | 74.35 | |
| Matryoshka SAEBackbone=DINOv2 ViT-L/142026.05 | 1 | 59.03 | 84.48 | 81.15 |