Image Classification on Tiny-ImageNet (train)
0.0043LossAdamW
Evaluation Results
| Method | Links | |
|---|---|---|
| AdamWNetwork=VGG-16/BN2025.05 | 0.0043 | |
| AdamWNetwork=ViT-7/8/8-3842025.05 | 0.0056 | |
| AdamWNetwork=ViT-7/8/12-7682025.05 | 0.0065 | |
| AdamWNetwork=ResNet-562025.05 | 0.0121 | |
| SAMNetwork=ViT-7/8/12-7682025.05 | 0.0297 | |
| Friendly-SAMNetwork=VGG-16/BN2025.05 | 0.0349 | |
| Friendly-SAMNetwork=ViT-7/8/8-3842025.05 | 0.0349 | |
| SAMNetwork=VGG-16/BN2025.05 | 0.0363 | |
| SAMNetwork=ViT-7/8/8-3842025.05 | 0.0363 | |
| Friendly-SAMNetwork=ViT-7/8/12-7682025.05 | 0.0441 | |
| Friendly-SAMNetwork=ResNet-562025.05 | 0.0444 | |
| SAMNetwork=ResNet-562025.05 | 0.0453 | |
| ASAMNetwork=ViT-7/8/12-7682025.05 | 0.0512 | |
| AdamWNetwork=ResNet-1102025.05 | 0.0556 | |
| ASAMNetwork=ResNet-562025.05 | 0.0564 | |
| ASAMNetwork=VGG-16/BN2025.05 | 0.0644 | |
| ASAMNetwork=ViT-7/8/8-3842025.05 | 0.0644 | |
| ZSharpNetwork=ResNet-562025.05 | 0.0828 | |
| ZSharpNetwork=VGG-16/BN2025.05 | 0.1248 | |
| ZSharpNetwork=ViT-7/8/8-3842025.05 | 0.1248 | |
| ZSharpNetwork=ViT-7/8/12-7682025.05 | 0.1341 | |
| Friendly-SAMNetwork=ResNet-1102025.05 | 0.1402 | |
| SAMNetwork=ResNet-1102025.05 | 0.1417 | |
| FedPAC_SOAPModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.156 | |
| FedPAC_MuonModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.171 | |
| FedPAC_SophiaModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.175 | |
| Local MuonModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.184 | |
| Local SophiaModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.188 | |
| Local SOAPModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.212 | |
| Local AdamWModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.252 | |
| ASAMNetwork=ResNet-1102025.05 | 0.2894 | |
| ZSharpNetwork=ResNet-1102025.05 | 0.4137 | |
| FedAvgModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.421 | |
| SCAFFOLDModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.432 | |
| FedCMModel Architecture=ViT-Base, Data Distribution=Dir-0.1, Communication Rounds=100, Number of Clients=50, Client Participation Rate=10%, Batch Size=16, Local Steps (K)=502026.02 | 0.708 |