Computational Efficiency on DINOv2 ViT-B/14 (layer 11)
380.83Latency (ms/batch)Backbone only
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Backbone onlyModel=DINOv2 ViT-B/14, Input dim=N/A, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 380.83 | 501.1 | |
| Vanilla SAEModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 417.18 | 5,664.75 | |
| JumpReLUModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 422.59 | 9,081.85 | |
| TopK-SAEModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 426.1 | 8,694.34 | |
| BatchTopK-SAEModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 427.95 | 8,678.56 | |
| Matryoshka SAEModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 428.55 | 8,678.56 | |
| Archetypal SAEModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 437.43 | 10 | |
| ELUDeModel=DINOv2 ViT-B/14, Input dim=3072, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 437.73 | 577.49 | |
| TranscoderModel=DINOv2 ViT-B/14, Input dim=3072, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 720.6 | 15 | |
| Matching PursuitModel=DINOv2 ViT-B/14, Input dim=768, Batch size=256, Hardware=single H100, torch.compile=enabled2026.05 | 1,186.13 | 12 |