Visual Task Adaptation on VTAB 1K (test)
78.8CIFAR-100 AccuracyVPT
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VPTParams. (M)=0.53, FLOPS (G)=18.302024.03 | 78.8 | 90.8 | 65.8 | 98 | 88.3 | 78.1 | 49.6 | 81.8 | 96.1 | 83.4 | 68.4 | 68.5 | 60 | 46.5 | 72.8 | 73.6 | 47.9 | 32.9 | 37.8 | 71.96 | |
| Res-TuningParams. (M)=0.51, FLOPS (G)=17.672024.03 | 75.2 | 92.7 | 71.9 | 99.3 | 91.9 | 86.7 | 58.5 | 86.7 | 95.6 | 85 | 74.6 | 80.2 | 63.6 | 50.6 | 80.2 | 85.4 | 55.7 | 31.9 | 42 | 76.32 | |
| DyTrr=0.7, Params. (M)=0.16, FLOPS (G)=14.922024.03 | 74.4 | 95.5 | 73.6 | 99.2 | 91.7 | 87.5 | 57.4 | 88.3 | 96.1 | 86.7 | 76.7 | 83.5 | 63.8 | 52.9 | 83.1 | 85.7 | 54.9 | 34.3 | 45.9 | 77.57 | |
| DyTrr=0.9, Params. (M)=0.16, FLOPS (G)=17.072024.03 | 74.3 | 94.9 | 73.1 | 99.2 | 91.4 | 87.8 | 57.1 | 87.9 | 96.1 | 85.9 | 76 | 83.3 | 64.8 | 51.5 | 83.4 | 84 | 54.8 | 35.1 | 46.4 | 77.3 | |
| DyTrr=0.5, Params. (M)=0.16, FLOPS (G)=12.542024.03 | 73.6 | 94.8 | 73 | 99.1 | 91.4 | 87 | 56.4 | 87.3 | 96.1 | 85.6 | 76.7 | 82.8 | 63.8 | 52.7 | 83.7 | 83.6 | 57.3 | 34.6 | 44.3 | 77.14 | |
| BitFitParams. (M)=0.10, FLOPS (G)=17.582024.03 | 72.8 | 87 | 59.2 | 97.5 | 85.3 | 59.9 | 51.4 | 78.7 | 91.6 | 72.9 | 69.8 | 61.5 | 55.6 | 32.4 | 55.9 | 66.6 | 40 | 15.7 | 25.1 | 65.21 | |
| ConvPassParams. (M)=0.33, FLOPS (G)=17.642024.03 | 72.3 | 91.2 | 72.2 | 99.2 | 90.9 | 91.3 | 54.9 | 84.2 | 96.1 | 85.3 | 75.6 | 82.3 | 67.9 | 51.3 | 80 | 85.9 | 53.1 | 36.4 | 44.4 | 76.56 | |
| FacT-TTParams. (M)=0.04, FLOPS (G)=17.582024.03 | 71.3 | 89.6 | 70.7 | 98.9 | 91 | 87.8 | 54.6 | 85.2 | 95.5 | 83.4 | 75.7 | 82 | 69 | 49.8 | 80 | 79.2 | 48.4 | 34.2 | 41.4 | 75.3 | |
| AdaptFormerParams. (M)=0.16, FLOPS (G)=17.612024.03 | 70.8 | 91.2 | 70.5 | 99.1 | 90.9 | 86.6 | 54.8 | 83 | 95.8 | 84.4 | 76.3 | 81.9 | 64.3 | 49.3 | 80.3 | 76.3 | 45.7 | 31.7 | 41.1 | 74.75 | |
| NOAHParams. (M)=0.36, FLOPS (G)=17.582024.03 | 69.6 | 92.7 | 70.2 | 99.1 | 90.4 | 86.1 | 53.7 | 84.4 | 95.4 | 83.9 | 75.8 | 82.8 | 68.9 | 49.9 | 81.7 | 81.8 | 48.3 | 32.8 | 44.2 | 75.48 | |
| AdapterParams. (M)=0.16, FLOPS (G)=17.612024.03 | 69.2 | 90.1 | 68 | 98.8 | 89.9 | 82.8 | 54.3 | 84 | 94.9 | 81.9 | 75.5 | 80.9 | 65.3 | 48.6 | 78.3 | 74.8 | 48.5 | 29.9 | 41.6 | 73.85 | |
| SSFParams. (M)=0.20, FLOPS (G)=17.582024.03 | 69 | 92.6 | 75.1 | 99.4 | 91.8 | 90.2 | 52.9 | 87.4 | 95.9 | 87.4 | 75.5 | 75.9 | 62.3 | 53.3 | 80.6 | 77.3 | 54.9 | 29.5 | 37.9 | 75.69 | |
| Full tuningParams. (M)=85.80, FLOPS (G)=17.582024.03 | 68.9 | 87.7 | 64.3 | 97.2 | 86.9 | 87.4 | 38.8 | 79.7 | 95.7 | 84.2 | 73.9 | 56.3 | 58.6 | 41.7 | 65.5 | 57.5 | 46.7 | 25.7 | 29.1 | 68.96 | |
| LORAParams. (M)=0.29, FLOPS (G)=17.582024.03 | 67.1 | 91.4 | 69.4 | 98.8 | 90.4 | 85.3 | 54 | 84.9 | 95.3 | 84.4 | 73.6 | 82.9 | 69.2 | 49.8 | 78.5 | 75.7 | 47.1 | 31 | 44 | 74.6 | |
| FrozenParams. (M)=0.00, FLOPS (G)=17.582024.03 | 63.4 | 85 | 63.2 | 97 | 86.3 | 36.6 | 51 | 78.5 | 87.5 | 68.6 | 74 | 34.3 | 30.6 | 33.2 | 55.4 | 12.5 | 20 | 9.6 | 19.2 | 57.64 |