Knowledge Retention on ImageNet
75.5Control AccuracyRandProj
Evaluation results
| Method | Links | |
|---|---|---|
| RandProjBackbone=ViT-L/14, Basis Ratio (M)=50%2025.02 | 75.5 | |
| AEBackbone=ViT-L/14, Basis Ratio (M)=50%2025.02 | 73.4 | |
| TABackbone=ViT-L/14, Basis Ratio (M)=50%2025.02 | 72.9 | |
| PCABackbone=ViT-L/14, Basis Ratio (M)=50%2025.02 | 72.4 | |
| RandProjBackbone=ViT-B/16, Basis Ratio (M)=50%2025.02 | 68.3 | |
| AEBackbone=ViT-B/16, Basis Ratio (M)=50%2025.02 | 65.9 | |
| TABackbone=ViT-B/16, Basis Ratio (M)=50%2025.02 | 65.4 | |
| TABackbone=ViT-B/32, Basis Ratio (M)=50%2025.02 | 64.9 | |
| PCABackbone=ViT-B/16, Basis Ratio (M)=50%2025.02 | 64.6 | |
| RandProjBackbone=ViT-B/32, Basis Ratio (M)=50%2025.02 | 63.3 | |
| PCABackbone=ViT-B/32, Basis Ratio (M)=50%2025.02 | 61 | |
| AEBackbone=ViT-B/32, Basis Ratio (M)=50%2025.02 | 60.5 | |
| Gradient AscentBackbone=ViT-L/14, Basis Ratio (M)=50%2025.02 | 16.3 | |
| Gradient AscentBackbone=ViT-B/16, Basis Ratio (M)=50%2025.02 | 0.7 | |
| Gradient AscentBackbone=ViT-B/32, Basis Ratio (M)=50%2025.02 | 0.3 |