Sparse Autoencoding on DINOv2 ImageNet-1k (patch tokens)
0.191MSEiSAE-ME
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| iSAE-MEFeatures=bidirectional, Regularization=aRIP, Encoding=multistep2026.05 | 0.191 | 0.137 | 35.6 | 0.451 | 30.5 | 0.494 | 0.807 | |
| TopKModel Variant=Standard TopK SAE baseline2026.05 | 0.217 | 0.163 | 51.9 | 0.442 | 32 | 0.576 | 0.836 | |
| AbsTopKFeatures=bidirectional, Activation Function=AbsTopK2026.05 | 0.235 | 0.159 | 52.4 | 0.424 | 37.4 | 0.462 | 0.862 | |
| iSAEFeatures=bidirectional, Regularization=aRIP2026.05 | 0.237 | 0.13 | 58.5 | 0.372 | 38.6 | 0.449 | 0.846 |