Image Classification on ImageNet-32 down-sampled (test)
0.4337Top-1 AccuracyOnDev-LCT-8/1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OnDev-LCT-8/1Evaluation Protocol=Centralized, #Params=1.04M, MACs=0.08G2024.01 | 0.4337 | 0.683 | |
| OnDev-LCT-4/1Evaluation Protocol=Centralized, #Params=0.64M, MACs=0.05G2024.01 | 0.4234 | 0.6733 | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=1.04M, MACs=0.08G2024.01 | 0.4103 | — | |
| OnDev-LCT-2/1Evaluation Protocol=Centralized, #Params=0.44M, MACs=0.04G2024.01 | 0.4059 | 0.6553 | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.64M, MACs=0.05G2024.01 | 0.3998 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.44M, MACs=0.04G2024.01 | 0.3859 | — | |
| OnDev-LCT-1/1Evaluation Protocol=Centralized, #Params=0.34M, MACs=0.03G2024.01 | 0.3846 | 0.6295 | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.34M, MACs=0.03G2024.01 | 0.3693 | — | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=1.04M, MACs=0.08G2024.01 | 0.3584 | — | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=1.04M, MACs=0.08G2024.01 | 0.3523 | — | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.64M, MACs=0.05G2024.01 | 0.3466 | — | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.64M, MACs=0.05G2024.01 | 0.3377 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.44M, MACs=0.04G2024.01 | 0.3293 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.44M, MACs=0.04G2024.01 | 0.3239 | — | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.34M, MACs=0.03G2024.01 | 0.3201 | — | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.34M, MACs=0.03G2024.01 | 0.3107 | — | |
| CCT-4/2Evaluation Protocol=Centralized, #Params=0.60M, MACs=0.05G2024.01 | 0.3027 | 0.5389 | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.60M, MACs=0.05G2024.01 | 0.2999 | — | |
| MobileNetv2/1.0Evaluation Protocol=Centralized, #Params=3.54M, MACs=0.01G2024.01 | 0.2984 | 0.546 | |
| ResNet-56Evaluation Protocol=Centralized, #Params=0.93M, MACs=0.13G2024.01 | 0.2818 | 0.5257 | |
| ResNet-44Evaluation Protocol=Centralized, #Params=0.73M, MACs=0.10G2024.01 | 0.2812 | 0.5235 | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=1.04M, MACs=0.08G2024.01 | 0.281 | — | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.93M, MACs=0.13G2024.01 | 0.2793 | — | |
| ResNet-32Evaluation Protocol=Centralized, #Params=0.53M, MACs=0.07G2024.01 | 0.2792 | 0.5198 | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=3.54M, MACs=0.01G2024.01 | 0.2776 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.73M, MACs=0.10G2024.01 | 0.2767 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.40M, MACs=0.03G2024.01 | 0.2743 | — | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.64M, MACs=0.05G2024.01 | 0.2728 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.53M, MACs=0.07G2024.01 | 0.2703 | — | |
| ResNet-20Evaluation Protocol=Centralized, #Params=0.34M, MACs=0.04G2024.01 | 0.2699 | 0.5038 | |
| CCT-2/2Evaluation Protocol=Centralized, #Params=0.40M, MACs=0.03G2024.01 | 0.2697 | 0.5004 | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.60M, MACs=0.05G2024.01 | 0.2646 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.44M, MACs=0.04G2024.01 | 0.2623 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=0.34M, MACs=0.04G2024.01 | 0.2613 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=2.66M, MACs=<0.01G2024.01 | 0.2558 | — | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.60M, MACs=0.05G2024.01 | 0.2521 | — | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=1.04M, MACs=0.08G2024.01 | 0.2487 | — | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=3.54M, MACs=0.01G2024.01 | 0.2478 | — | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.34M, MACs=0.03G2024.01 | 0.2468 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.40M, MACs=0.03G2024.01 | 0.2414 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=2.66M, MACs=<0.01G2024.01 | 0.236 | — | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.93M, MACs=0.13G2024.01 | 0.2356 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.73M, MACs=0.10G2024.01 | 0.2345 | — | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.64M, MACs=0.05G2024.01 | 0.2327 | — | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.93M, MACs=0.13G2024.01 | 0.2306 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.73M, MACs=0.10G2024.01 | 0.2304 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.53M, MACs=0.07G2024.01 | 0.2282 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.40M, MACs=0.03G2024.01 | 0.2271 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=0.34M, MACs=0.04G2024.01 | 0.2218 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.34M, MACs=0.04G2024.01 | 0.2209 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=0.53M, MACs=0.07G2024.01 | 0.2184 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.44M, MACs=0.04G2024.01 | 0.2178 | — | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.60M, MACs=0.05G2024.01 | 0.2092 | — | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.34M, MACs=0.03G2024.01 | 0.2091 | — | |
| MobileNetv2/0.75Evaluation Protocol=Centralized, #Params=2.66M, MACs=<0.01G2024.01 | 0.2066 | 0.4272 | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=1.99M, MACs=<0.01G2024.01 | 0.2028 | — | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=3.54M, MACs=0.01G2024.01 | 0.2014 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.40M, MACs=0.03G2024.01 | 0.1916 | — | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=1.99M, MACs=<0.01G2024.01 | 0.1887 | — | |
| MobileNetv2/0.5Evaluation Protocol=Centralized, #Params=1.99M, MACs=<0.01G2024.01 | 0.1844 | 0.3922 | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.93M, MACs=0.13G2024.01 | 0.1842 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=2.66M, MACs=<0.01G2024.01 | 0.1804 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.53M, MACs=0.07G2024.01 | 0.1789 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.73M, MACs=0.10G2024.01 | 0.1725 | — | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=3.54M, MACs=0.01G2024.01 | 0.1692 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=0.34M, MACs=0.04G2024.01 | 0.1664 | — | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=3.54M, MACs=0.01G2024.01 | 0.1658 | — | |
| OnDev-LCT-8/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=1.04M, MACs=0.08G2024.01 | 0.1632 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=2.66M, MACs=<0.01G2024.01 | 0.1627 | — | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=1.99M, MACs=<0.01G2024.01 | 0.1619 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=2.66M, MACs=<0.01G2024.01 | 0.1585 | — | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.60M, MACs=0.05G2024.01 | 0.1582 | — | |
| OnDev-LCT-4/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.64M, MACs=0.05G2024.01 | 0.1554 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.73M, MACs=0.10G2024.01 | 0.1516 | — | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.93M, MACs=0.13G2024.01 | 0.1503 | — | |
| OnDev-LCT-2/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.44M, MACs=0.04G2024.01 | 0.1484 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.53M, MACs=0.07G2024.01 | 0.1478 | — | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=1.99M, MACs=<0.01G2024.01 | 0.1409 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.40M, MACs=0.03G2024.01 | 0.1407 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=0.34M, MACs=0.04G2024.01 | 0.1391 | — | |
| OnDev-LCT-1/1Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.34M, MACs=0.03G2024.01 | 0.1387 | — | |
| ViT-Lite-2/4Evaluation Protocol=Centralized, #Params=1.48M, MACs=0.07G2024.01 | 0.1294 | 0.3031 | |
| ResNet-56Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.93M, MACs=0.13G2024.01 | 0.1245 | — | |
| ViT-Lite-1/4Evaluation Protocol=Centralized, #Params=1.46M, MACs=0.04G2024.01 | 0.1176 | 0.2739 | |
| ViT-Lite-2/4Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=1.48M, MACs=0.07G2024.01 | 0.1173 | — | |
| ResNet-44Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.73M, MACs=0.10G2024.01 | 0.1132 | — | |
| CCT-4/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.60M, MACs=0.05G2024.01 | 0.112 | — | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.1, #Params=1.99M, MACs=<0.01G2024.01 | 0.1116 | — | |
| ViT-Lite-2/4Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=1.48M, MACs=0.07G2024.01 | 0.1108 | — | |
| MobileNetv2/1.0Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=3.54M, MACs=0.01G2024.01 | 0.11 | — | |
| MobileNetv2/0.75Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=2.66M, MACs=<0.01G2024.01 | 0.1063 | — | |
| ViT-Lite-1/4Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=5, #Params=1.46M, MACs=0.04G2024.01 | 0.1061 | — | |
| CCT-2/2Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.40M, MACs=0.03G2024.01 | 0.1026 | — | |
| ResNet-32Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.53M, MACs=0.07G2024.01 | 0.1023 | — | |
| ViT-Lite-1/4Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=5, #Params=1.46M, MACs=0.04G2024.01 | 0.1018 | — | |
| ViT-Lite-2/4Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=1.48M, MACs=0.07G2024.01 | 0.0935 | — | |
| ResNet-20Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=0.34M, MACs=0.04G2024.01 | 0.0908 | — | |
| MobileNetv2/0.5Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.1, #Params=1.99M, MACs=<0.01G2024.01 | 0.089 | — | |
| ViT-Lite-1/4Evaluation Protocol=FedAvg, Number of Clients=10, Beta (β)=0.5, #Params=1.46M, MACs=0.04G2024.01 | 0.0853 | — | |
| ViT-Lite-2/4Evaluation Protocol=FedAvg, Number of Clients=50, Beta (β)=0.5, #Params=1.48M, MACs=0.07G2024.01 | 0.08 | — |