Image Classification on Tiny-ImageNet 1.0 (test)
67.64Accuracy (Natural)S2HPruner
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| S2HPrunerBackbone=ResNet-50, FLOPs=55%2024.10 | 67.64 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=ResNet-50, FLOPs=35%2024.10 | 67.38 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=ResNet-50, FLOPs=15%2024.10 | 67.02 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=MBV3, FLOPs=55%2024.10 | 65.54 | — | — | — | — | — | — | — | — | — | |
| OTOv2Backbone=ResNet-50, FLOPs=55%2024.10 | 65.16 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=MBV3, FLOPs=35%2024.10 | 65.11 | — | — | — | — | — | — | — | — | — | |
| RefillBackbone=ResNet-50, FLOPs=55%2024.10 | 65.02 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=ResNet-50, FLOPs=55%2024.10 | 64.78 | — | — | — | — | — | — | — | — | — | |
| RefillBackbone=ResNet-50, FLOPs=35%2024.10 | 64.14 | — | — | — | — | — | — | — | — | — | |
| OTOv2Backbone=ResNet-50, FLOPs=35%2024.10 | 63.45 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=WRN28-10, FLOPs=55%2024.10 | 63.44 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=ResNet-50, FLOPs=35%2024.10 | 63.24 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=ResNet-50, FLOPs=15%2024.10 | 63.03 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=MBV3, FLOPs=55%2024.10 | 62.76 | — | — | — | — | — | — | — | — | — | |
| RefillBackbone=MBV3, FLOPs=55%2024.10 | 62.49 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=MBV3, FLOPs=15%2024.10 | 62.49 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=WRN28-10, FLOPs=35%2024.10 | 62.46 | — | — | — | — | — | — | — | — | — | |
| RefillBackbone=WRN28-10, FLOPs=55%2024.10 | 62.22 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=WRN28-10, FLOPs=55%2024.10 | 62.12 | — | — | — | — | — | — | — | — | — | |
| AWPBackbone=WideResNet-34-102023.03 | 61.9 | 35.5 | 32.8 | 31 | 31.6 | 31.1 | 29.6 | — | — | — | |
| RefillBackbone=MBV3, FLOPs=35%2024.10 | 61.84 | — | — | — | — | — | — | — | — | — | |
| RefillBackbone=WRN28-10, FLOPs=35%2024.10 | 61.83 | — | — | — | — | — | — | — | — | — | |
| S2HPrunerBackbone=WRN28-10, FLOPs=15%2024.10 | 61.83 | — | — | — | — | — | — | — | — | — | |
| HELPBackbone=WideResNet-34-102023.03 | 61.8 | 35.9 | 33 | 31.3 | 31.8 | 31.3 | 29.8 | — | — | — | |
| OTOv2Backbone=WRN28-10, FLOPs=55%2024.10 | 61.7 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=WRN28-10, FLOPs=35%2024.10 | 61.41 | — | — | — | — | — | — | — | — | — | |
| AWP + CAFEBackbone=WideResNet-34-102023.03 | 61.4 | 36.6 | 34.2 | 32.3 | 33.2 | 32.5 | 30.8 | — | — | — | |
| RST-SBackbone=MBV3, FLOPs=35%2024.10 | 61.26 | — | — | — | — | — | — | — | — | — | |
| OTOv2Backbone=WRN28-10, FLOPs=35%2024.10 | 61.23 | — | — | — | — | — | — | — | — | — | |
| HELP + CAFEBackbone=WideResNet-34-102023.03 | 61.1 | 37 | 34.7 | 32.6 | 33.8 | 32.8 | 31.2 | — | — | — | |
| RefillBackbone=ResNet-50, FLOPs=15%2024.10 | 61.05 | — | — | — | — | — | — | — | — | — | |
| ADVBackbone=WideResNet-34-102023.03 | 60.9 | 29.8 | 25.5 | 25.8 | 24.2 | 26 | 23.9 | — | — | — | |
| TRADESBackbone=WideResNet-34-102023.03 | 60.8 | 30.5 | 26.4 | 26.7 | 25 | 26.8 | 24.6 | — | — | — | |
| MARTBackbone=WideResNet-34-102023.03 | 60.7 | 29.9 | 25.6 | 25.9 | 24 | 25.5 | 23.6 | — | — | — | |
| ADV + CAFEBackbone=WideResNet-34-102023.03 | 60.6 | 31.1 | 27.3 | 27.2 | 25.8 | 27.4 | 25.4 | — | — | — | |
| MART + CAFEBackbone=WideResNet-34-102023.03 | 60.4 | 31.2 | 27.5 | 26.8 | 25.5 | 27 | 25.1 | — | — | — | |
| OTOv2Backbone=ResNet-50, FLOPs=15%2024.10 | 60.38 | — | — | — | — | — | — | — | — | — | |
| TRADES + CAFEBackbone=WideResNet-34-102023.03 | 60.3 | 31.7 | 28.2 | 28.3 | 27 | 28.5 | 26.5 | — | — | — | |
| OTOv2Backbone=MBV3, FLOPs=55%2024.10 | 60.16 | — | — | — | — | — | — | — | — | — | |
| OTOv2Backbone=MBV3, FLOPs=35%2024.10 | 59.25 | — | — | — | — | — | — | — | — | — | |
| RST-SBackbone=WRN28-10, FLOPs=15%2024.10 | 58.03 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=WRN28-10, FLOPs=55%2024.10 | 57.64 | — | — | — | — | — | — | — | — | — | |
| OTOv2Backbone=MBV3, FLOPs=15%2024.10 | 57.61 | — | — | — | — | — | — | — | — | — | |
| ADVBackbone=ResNet-182023.03 | 57.2 | 27.3 | 24.2 | 23.2 | 22.8 | 23.2 | 21.8 | — | — | — | |
| OTOv2Backbone=WRN28-10, FLOPs=15%2024.10 | 57.19 | — | — | — | — | — | — | — | — | — | |
| MARTBackbone=ResNet-182023.03 | 57.1 | 27.4 | 24.2 | 23.2 | 22.9 | 23.2 | 22.2 | — | — | — | |
| RefillBackbone=WRN28-10, FLOPs=15%2024.10 | 56.64 | — | — | — | — | — | — | — | — | — | |
| AWP + CAFEBackbone=ResNet-182023.03 | 56.6 | 31.4 | 29.2 | 27.1 | 28.4 | 27 | 26.5 | — | — | — | |
| TRADESBackbone=ResNet-182023.03 | 56.5 | 28.4 | 25.3 | 24.4 | 24.2 | 24.3 | 23.2 | — | — | — | |
| ADV + CAFEBackbone=ResNet-182023.03 | 56.3 | 28.6 | 25.7 | 24.7 | 24.4 | 24.6 | 23.5 | — | — | — | |
| AWPBackbone=ResNet-182023.03 | 56.2 | 30.5 | 28.5 | 26.2 | 27.6 | 26.2 | 25.5 | — | — | — | |
| HELPBackbone=ResNet-182023.03 | 56.1 | 31 | 28.6 | 26.3 | 27.7 | 26.3 | 25.7 | — | — | — | |
| MART + CAFEBackbone=ResNet-182023.03 | 55.9 | 28.6 | 25.9 | 24.6 | 24.7 | 24.5 | 23.5 | — | — | — | |
| Group-SLBackbone=ResNet-50, FLOPs=55%2024.10 | 55.49 | — | — | — | — | — | — | — | — | — | |
| HELP + CAFEBackbone=ResNet-182023.03 | 55.4 | 32 | 29.7 | 27.4 | 29.2 | 27.8 | 27.3 | — | — | — | |
| RST-SBackbone=MBV3, FLOPs=15%2024.10 | 55.13 | — | — | — | — | — | — | — | — | — | |
| TRADES + CAFEBackbone=ResNet-182023.03 | 54.5 | 29.6 | 27.4 | 26.3 | 26.5 | 26.2 | 25.4 | — | — | — | |
| RefillBackbone=MBV3, FLOPs=15%2024.10 | 53.87 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=MBV3, FLOPs=55%2024.10 | 53.43 | — | — | — | — | — | — | — | — | — | |
| ADVBackbone=VGG-162023.03 | 53.2 | 25.3 | 21.5 | 21 | 20.2 | 20.8 | 19.6 | — | — | — | |
| MARTBackbone=VGG-162023.03 | 53.1 | 25 | 21.5 | 21.2 | 20.4 | 21 | 19.9 | — | — | — | |
| MART + CAFEBackbone=VGG-162023.03 | 53 | 25.6 | 22.3 | 21.6 | 21.3 | 21.5 | 20.5 | — | — | — | |
| HELPBackbone=VGG-162023.03 | 53 | 28.3 | 25.9 | 23.9 | 25.1 | 23.8 | 23.1 | — | — | — | |
| AWP + CAFEBackbone=VGG-162023.03 | 52.9 | 28.8 | 26.4 | 24.2 | 25.6 | 24.1 | 23.4 | — | — | — | |
| TRADESBackbone=VGG-162023.03 | 52.8 | 25.9 | 22.5 | 21.9 | 21.5 | 21.8 | 20.7 | — | — | — | |
| ADV + CAFEBackbone=VGG-162023.03 | 52.6 | 26 | 22.8 | 22.1 | 21.8 | 22 | 21 | — | — | — | |
| AWPBackbone=VGG-162023.03 | 52.6 | 28 | 25.7 | 23.6 | 24.8 | 23.5 | 22.8 | — | — | — | |
| HELP + CAFEBackbone=VGG-162023.03 | 52.6 | 29.4 | 27.1 | 24.7 | 26.4 | 24.4 | 23.9 | — | — | — | |
| TRADES + CAFEBackbone=VGG-162023.03 | 52.1 | 26.5 | 23.6 | 22.6 | 22.5 | 22.6 | 21.6 | — | — | — | |
| Group-SLBackbone=WRN28-10, FLOPs=35%2024.10 | 25.74 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=ResNet-50, FLOPs=35%2024.10 | 19.94 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=MBV3, FLOPs=35%2024.10 | 2.35 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=ResNet-50, FLOPs=15%2024.10 | 0.95 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=WRN28-10, FLOPs=15%2024.10 | 0.85 | — | — | — | — | — | — | — | — | — | |
| Group-SLBackbone=MBV3, FLOPs=15%2024.10 | 0.56 | — | — | — | — | — | — | — | — | — | |
| CentralModel Architecture=ConvNet2024.12 | — | — | — | — | — | — | — | 49.73 | 49.73 | 49.73 | |
| CentralModel Architecture=ResNet-182024.12 | — | — | — | — | — | — | — | 61.98 | 61.98 | 61.98 | |
| Co-BoostingModel Architecture=ConvNet2024.12 | — | — | — | — | — | — | — | 6.66 | 9.81 | 10.75 | |
| Co-BoostingModel Architecture=ResNet-182024.12 | — | — | — | — | — | — | — | 10.29 | 14.35 | 16.39 | |
| DENSEModel Architecture=ConvNet2024.12 | — | — | — | — | — | — | — | 11.45 | 14.69 | 15.15 | |
| DENSEModel Architecture=ResNet-182024.12 | — | — | — | — | — | — | — | 8.88 | 13.05 | 17.24 | |
| F-DAFLModel Architecture=ConvNet2024.12 | — | — | — | — | — | — | — | 5.25 | 8.89 | 10.28 | |
| F-DAFLModel Architecture=ResNet-182024.12 | — | — | — | — | — | — | — | 7.91 | 12.3 | 13.31 | |
| FedSD2CModel Architecture=ConvNet2024.12 | — | — | — | — | — | — | — | 20.73 | 23.53 | 24.1 | |
| FedSD2CModel Architecture=ResNet-182024.12 | — | — | — | — | — | — | — | 26.83 | 29.92 | 31.66 |