SAE Interpretability and Faithfulness Evaluation on SigLIP2-B 16 activations
6LLM RankSigLIP2-B/16 (backbone only)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SigLIP2-B/16 (backbone only)Backbone=SigLIP2-B/162026.05 | 6 | 34.97 | 78.08 | 100 | |
| Archetypal SAEBackbone=SigLIP2-B/162026.05 | 5 | 37.05 | 74.44 | 77.63 | |
| Matryoshka SAEBackbone=SigLIP2-B/162026.05 | 4 | 44.24 | 77.73 | 93.82 | |
| BatchTopK-SAEBackbone=SigLIP2-B/162026.05 | 3 | 44.83 | 77.69 | 93.69 | |
| ELUDeBackbone=SigLIP2-B/162026.05 | 2 | 67.98 | 78.08 | 100 | |
| Matching PursuitBackbone=SigLIP2-B/162026.05 | 1 | 55.71 | 77.94 | 95.62 |