Image Classification on CIFAR-100, SVHN, Food-101, Air, Pet, Car
92.03Accuracy (CIFAR-100)AdaptFormer
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AdaptFormerParams (M)=1.19, FLOPS (G)=17.812024.03 | 92.03 | 97.23 | 90.84 | 78.23 | 94.46 | 87.33 | 90.02 | |
| VPTParams (M)=0.07, FLOPS (G)=18.322024.03 | 91.46 | 95.72 | 90.41 | 68.91 | 93.92 | 80.72 | 86.88 | |
| LoRAParams (M)=1.19, FLOPS (G)=17.582024.03 | 91.42 | 97.36 | 90.48 | 76.32 | 93.62 | 87 | 89.36 | |
| DyTParams (M)=1.19, FLOPS (G)=12.212024.03 | 91.37 | 97.08 | 90.32 | 78.92 | 94.45 | 87.8 | 89.99 | |
| DyT + N = 4Params (M)=4.80, FLOPS (G)=12.292024.03 | 91.01 | 96.9 | 89.77 | 78.27 | 93.85 | 87.61 | 89.56 | |
| Full tuningParams (M)=85.80, FLOPS (G)=17.582024.03 | 90.91 | 97.29 | 90.69 | 80.53 | 93.11 | 88.71 | 90.21 | |
| LinearParams (M)=0, FLOPS (G)=17.582024.03 | 85.87 | 56.29 | 88.07 | 40.51 | 92.78 | 52.85 | 69.4 | |
| Dynamic-FullParams (M)=85.80, FLOPS (G)=12.242024.03 | 83.43 | 96.9 | 84.46 | 62.5 | 75.16 | 70.48 | 78.82 |