Image Classification on Visual Decathlon Challenge 1.0 (test)
79.64Mean AccuracyNETTAILOR
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NETTAILORAvg Params=3.67, Avg FLOPS=0.61, Backbone=WRN-26, Resolution=72x722019.06 | 79.64 | 61.42 | 75.07 | 81.84 | 94.68 | 61.28 | 99.52 | 86.53 | 90.09 | 96.44 | 49.54 | — | — | 3,744 | |
| TAPSλ=0.25, Params=5.24x2022.03 | 78.7 | — | 66.58 | 81.76 | 97.07 | 58.83 | 99.07 | 86.99 | 88.79 | 95.72 | 51.92 | 3,533 | — | — | |
| PAParams=2x2022.03 | 78.1 | — | 64.2 | 81.9 | 94.7 | 58.8 | 99.4 | 84.7 | 89.2 | 96.5 | 50.9 | 3,412 | — | — | |
| Spot-tuneParams=11x2022.03 | 78.1 | — | 63.9 | 80.5 | 96.5 | 57.1 | 99.5 | 85.2 | 88.8 | 96.7 | 52.3 | 3,612 | — | — | |
| ResAdaptAvg Params=6.44, Avg FLOPS=0.96, Backbone=WRN-26, Resolution=72x722019.06 | 78.07 | 60.32 | 64.21 | 81.91 | 94.73 | 58.83 | 99.38 | 84.68 | 89.21 | 96.54 | 50.94 | — | — | 3,412 | |
| TAPSλ=1.0, Params=3.13x2022.03 | 77.77 | — | 63.43 | 81.04 | 96.99 | 58.19 | 98.38 | 84.08 | 89.16 | 94.99 | 51.1 | 3,088 | — | — | |
| TAPSλ=0.50, Params=3.88x2022.03 | 77.61 | — | 62.05 | 81.74 | 97.13 | 57.02 | 98.4 | 85.8 | 88.96 | 95.62 | 49.06 | 3,180 | — | — | |
| TAPSλ=0.75, Params=3.43x2022.03 | 77.56 | — | 62.62 | 81.07 | 95.77 | 57.34 | 98.61 | 85.67 | 89 | 95.65 | 49.56 | 3,096 | — | — | |
| WTPBParams=10x(3.25x)2022.03 | 77.2 | — | 52.8 | 82 | 96.2 | 58.7 | 99.2 | 88.2 | 89.2 | 96.8 | 48.6 | 3,497 | — | — | |
| Res. Adapt (Joint)#par=22017.05 | 77.17 | 59.23 | 63.73 | 81.31 | 93.3 | 57.02 | 97.47 | 83.43 | 89.82 | 96.17 | 50.28 | 2,643 | — | — | |
| Res. Adapt. (J)#par=22018.01 | 77.17 | 59.23 | 63.73 | 81.31 | 93.3 | 57.02 | 97.47 | 83.43 | 89.82 | 96.17 | 50.28 | 2,643 | — | — | |
| DAN#par=2.172017.05 | 77.01 | 57.74 | 64.12 | 80.07 | 91.3 | 56.54 | 98.46 | 86.05 | 89.67 | 96.77 | 49.38 | 2,851 | — | — | |
| DAN#par=2.172018.01 | 77.01 | 57.74 | 64.12 | 80.07 | 91.3 | 56.54 | 98.46 | 86.05 | 89.67 | 96.77 | 49.38 | 2,851 | — | — | |
| DANAvg Params=6.54, Avg FLOPS=0.97, Backbone=WRN-26, Resolution=72x722019.06 | 77.01 | 57.74 | 64.12 | 80.07 | 91.3 | 56.54 | 98.46 | 86.05 | 89.67 | 96.77 | 49.38 | — | — | 2,851 | |
| DAMParams=2.17x2022.03 | 77 | — | 64.1 | 80.1 | 91.3 | 56.5 | 98.5 | 86.1 | 89.7 | 96.8 | 49.4 | 2,851 | — | — | |
| LWF#par=102017.05 | 76.93 | 59.87 | 61.15 | 82.23 | 92.34 | 58.83 | 97.57 | 83.05 | 88.08 | 96.1 | 50.04 | 2,515 | — | — | |
| LwFAvg Params=5.86, Avg FLOPS=0.87, Backbone=WRN-26, Resolution=72x722019.06 | 76.93 | 59.87 | 61.15 | 82.23 | 92.34 | 58.83 | 97.57 | 83.05 | 88.08 | 96.1 | 50.04 | — | — | 2,515 | |
| Piggyback#par=1.282018.01 | 76.6 | 57.69 | 65.29 | 79.87 | 96.99 | 57.45 | 97.27 | 79.09 | 87.63 | 97.24 | 47.48 | 2,838 | — | — | |
| PiggybackAvg Params=6.04, Avg FLOPS=0.87, Backbone=WRN-26, Resolution=72x722019.06 | 76.6 | 57.69 | 65.29 | 79.87 | 96.99 | 57.45 | 97.27 | 79.09 | 87.63 | 97.24 | 47.48 | — | — | 2,838 | |
| PiggybackParams=10x(3.25x)2022.03 | 76.6 | — | 65.3 | 79.9 | 97 | 57.5 | 97.3 | 79.1 | 87.6 | 97.2 | 47.5 | 2,838 | — | — | |
| Finetune#par=102017.05 | 76.51 | 59.87 | 60.34 | 82.12 | 92.82 | 55.53 | 97.53 | 81.41 | 87.69 | 96.55 | 51.2 | 2,500 | — | — | |
| Finetune#par=102018.01 | 76.51 | 59.87 | 60.34 | 82.12 | 92.82 | 55.53 | 97.53 | 81.41 | 87.69 | 96.55 | 51.2 | 2,500 | — | — | |
| Fine TuningParams=10x2022.03 | 76.5 | — | 60.3 | 82.1 | 92.8 | 55.5 | 97.5 | 81.4 | 87.7 | 96.6 | 51.2 | 2,500 | — | — | |
| BA^2Params=6.13x (2.28x)2022.03 | 75.7 | — | 49.9 | 78.1 | 95.5 | 55.1 | 99.4 | 86.1 | 88.7 | 96.9 | 50.2 | 3,199 | — | — | |
| Res. Adapt.Params=2x2022.03 | 73.9 | — | 56.7 | 81.2 | 93.9 | 50.9 | 97.1 | 66.2 | 89.6 | 96.1 | 47.5 | 2,118 | — | — | |
| Res. Adapt.#par=22017.05 | 73.88 | 59.67 | 56.68 | 81.2 | 93.88 | 50.85 | 97.05 | 66.24 | 89.62 | 96.13 | 47.45 | 2,118 | — | — | |
| Res. Adapt.#par=22018.01 | 73.88 | 59.67 | 56.68 | 81.2 | 93.88 | 50.85 | 97.05 | 66.24 | 89.62 | 96.13 | 47.45 | 2,118 | — | — | |
| Scratch#par=102017.05 | 70.32 | 59.87 | 57.1 | 75.73 | 91.2 | 37.77 | 96.55 | 56.3 | 88.74 | 96.63 | 43.27 | 1,625 | — | — | |
| Scratch#par=102018.01 | 70.32 | 59.87 | 57.1 | 75.73 | 91.2 | 37.77 | 96.55 | 56.3 | 88.74 | 96.63 | 43.27 | 1,625 | — | — | |
| Fixed FeatureParams=1x2022.03 | 54.3 | — | 23.3 | 63.1 | 80.3 | 45.4 | 68.2 | 73.7 | 58.5 | 43.5 | 26.8 | 544 | — | — | |
| Feature#par=12017.05 | 54.28 | 59.67 | 23.31 | 63.11 | 80.33 | 45.37 | 68.16 | 73.69 | 58.79 | 43.54 | 26.8 | 544 | — | — | |
| Feature#par=12018.01 | 54.28 | 59.67 | 23.31 | 63.11 | 80.33 | 45.37 | 68.16 | 73.69 | 58.79 | 43.54 | 26.8 | 544 | — | — | |
| Feature-CriticClassifier=SVM, Backbone=ResNet-182019.01 | 42.29 | — | — | — | — | — | — | — | — | — | — | — | 344 | — | |
| ReptileClassifier=SVM, Backbone=ResNet-182019.01 | 41.28 | — | — | — | — | — | — | — | — | — | — | — | 324 | — | |
| Data AggregationClassifier=SVM, Backbone=ResNet-182019.01 | 40.27 | — | — | — | — | — | — | — | — | — | — | — | 290 | — | |
| CrossGradClassifier=SVM, Backbone=ResNet-182019.01 | 40.03 | — | — | — | — | — | — | — | — | — | — | — | 280 | — | |
| MetaReg-FLClassifier=SVM, Backbone=ResNet-182019.01 | 38.75 | — | — | — | — | — | — | — | — | — | — | — | 296 | — | |
| ImageNet Pre-trainedClassifier=SVM, Backbone=ResNet-182019.01 | 38.71 | — | — | — | — | — | — | — | — | — | — | — | 308 | — | |
| Feature-CriticClassifier=KNN, Backbone=ResNet-182019.01 | 34.96 | — | — | — | — | — | — | — | — | — | — | — | 236 | — | |
| MetaRegClassifier=SVM, Backbone=ResNet-182019.01 | 34.02 | — | — | — | — | — | — | — | — | — | — | — | 269 | — | |
| CrossGradClassifier=KNN, Backbone=ResNet-182019.01 | 33.47 | — | — | — | — | — | — | — | — | — | — | — | 188 | — | |
| ReptileClassifier=KNN, Backbone=ResNet-182019.01 | 32.73 | — | — | — | — | — | — | — | — | — | — | — | 201 | — | |
| Data AggregationClassifier=KNN, Backbone=ResNet-182019.01 | 32.52 | — | — | — | — | — | — | — | — | — | — | — | 189 | — | |
| ImageNet Pre-trainedClassifier=KNN, Backbone=ResNet-182019.01 | 31.83 | — | — | — | — | — | — | — | — | — | — | — | 215 | — | |
| MetaReg-FLClassifier=KNN, Backbone=ResNet-182019.01 | 31.41 | — | — | — | — | — | — | — | — | — | — | — | 215 | — | |
| MetaRegClassifier=KNN, Backbone=ResNet-182019.01 | 24.51 | — | — | — | — | — | — | — | — | — | — | — | 144 | — | |
| Feature-CriticK=102019.01 | 24.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReptileK=102019.01 | 23.42 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Im.N. PTK=102019.01 | 23.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CrossGradK=102019.01 | 22.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MR-FLK=102019.01 | 22.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AGGK=102019.01 | 22.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Feature-CriticK=82019.01 | 22.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MR-FLK=82019.01 | 21.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Im.N. PTK=82019.01 | 21.58 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AGGK=82019.01 | 21.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReptileK=82019.01 | 21.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CrossGradK=82019.01 | 20.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Feature-CriticK=Ave2019.01 | 20.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReptileK=Ave2019.01 | 19.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReptileK=52019.01 | 19.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Im.N. PTK=Ave2019.01 | 19.12 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Feature-CriticK=52019.01 | 19.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AGGK=Ave2019.01 | 18.92 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CrossGradK=Ave2019.01 | 18.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MR-FLK=Ave2019.01 | 18.72 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AGGK=52019.01 | 18 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CrossGradK=52019.01 | 17.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Im.N. PTK=52019.01 | 17.63 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MR-FLK=52019.01 | 17.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRK=102019.01 | 15.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Feature-CriticK=32019.01 | 15.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReptileK=32019.01 | 14.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRK=82019.01 | 14.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CrossGradK=32019.01 | 14.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Im.N. PTK=32019.01 | 13.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AGGK=32019.01 | 13.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MR-FLK=32019.01 | 13.26 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRK=Ave2019.01 | 12.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRK=52019.01 | 12.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MRK=32019.01 | 8.86 | — | — | — | — | — | — | — | — | — | — | — | — | — |