Image Classification on CIFAR-100 VTAB-1K
79AccuracyPACE
Evaluation Results
| Method | Links | |
|---|---|---|
| PACEBackbone=ViT-B, Pre-training=ImageNet-21K, Base Method=LoRA_mul + VPT_add2024.09 | 79 | |
| PACEBackbone=Swin-B, Pre-training=ImageNet-21K, Base Method=LoRA_mul + VPT_add2024.09 | 78.9 | |
| PACEBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K, Base Method=LoRA_mul + VPT_add2024.09 | 78 | |
| LoRA_mul + VPT_addBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 74.9 | |
| LoRA_mul + VPT_addBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 74.6 | |
| LoRA_add + VPT_addBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 74.5 | |
| LoRA_addBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 74.3 | |
| LoRA_mulBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 73.9 | |
| LoRA_mul + VPT_addBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 73.8 | |
| VPT_addBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 73.6 | |
| LoRA_mulBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 73.4 | |
| LoRA_mulBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 73.2 | |
| VPT_addBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 72.7 | |
| VPT_addBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 71.8 | |
| LoRA_add + VPT_addBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 71.8 | |
| LoRA_addBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 71.3 | |
| LoRA_addBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 71.2 | |
| LoRA_add + VPT_addBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 70.3 | |
| Full Fine-tuningBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 65.6 | |
| Linear ProbingBackbone=Swin-B, Pre-training=ImageNet-21K2024.09 | 65 | |
| Linear ProbingBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 63.4 | |
| Linear ProbingBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 61.9 | |
| Full Fine-tuningBackbone=ViT-B, Pre-training=ImageNet-21K2024.09 | 51.6 | |
| Full Fine-tuningBackbone=ViT-B, Pre-training=Laion2B-ImageNet-12K2024.09 | 51.2 |