Image Classification on CINIC-10 (test)
95.8AccuracyViT-L/16 + Background
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ViT-L/16 + BackgroundArchitecture=ViT-L/16, Epochs=2, Spinal FC=false, Background Class=true2023.05 | 95.8 | — | — | — | — | |
| ViT-L/16 + (Spinal FC & Background)Architecture=ViT-L/16, Epochs=2, Spinal FC=true, Background Class=true2023.05 | 95.8 | — | — | — | — | |
| ViT-L/16 + Spinal FCArchitecture=ViT-L/16, Epochs=2, Spinal FC=true, Background Class=false2023.05 | 95.43 | — | — | — | — | |
| ViT-L/16Architecture=ViT-L/16, Epochs=2, Spinal FC=false, Background Class=false2023.05 | 95.11 | — | — | — | — | |
| Efficient Adaptive Ensemblingensemble size=2 weak models2022.06 | 95.064 | 0.764 | — | — | — | |
| SOTA2022.06 | 94.3 | — | — | — | — | |
| ProxyFLalpha=1, Labeling Ratio=20%2026.02 | 81.46 | — | — | — | — | |
| FedAvg-SLalpha=1, Labeling Ratio=20%2026.02 | 81.29 | — | — | — | — | |
| ProxyFLalpha=0.5, Labeling Ratio=20%2026.02 | 81.02 | — | — | — | — | |
| ProxyFLalpha=0.1, Labeling Ratio=20%2026.02 | 80.8 | — | — | — | — | |
| FedAvg-SLalpha=0.5, Labeling Ratio=20%2026.02 | 80.42 | — | — | — | — | |
| SAGEalpha=1, Labeling Ratio=20%2026.02 | 78.77 | — | — | — | — | |
| SAGEalpha=0.5, Labeling Ratio=20%2026.02 | 78.23 | — | — | — | — | |
| DeepFedNASBillion MACs=2.45-3.752026.01 | 77.85 | — | — | — | — | |
| FedAvg-SLalpha=0.1, Labeling Ratio=20%2026.02 | 77.82 | — | — | — | — | |
| FixMatch-GPLalpha=1, Labeling Ratio=20%2026.02 | 77.82 | — | — | — | — | |
| DeepFedNASBillion MACs=1.45-2.452026.01 | 77.8 | — | — | — | — | |
| FedDurealpha=1, Labeling Ratio=20%2026.02 | 77.75 | — | — | — | — | |
| DeepFedNASBillion MACs=0.95-1.452026.01 | 77.6 | — | — | — | — | |
| SAGEalpha=0.1, Labeling Ratio=20%2026.02 | 77.51 | — | — | — | — | |
| FixMatch-GPLalpha=0.5, Labeling Ratio=20%2026.02 | 77.35 | — | — | — | — | |
| FedDurealpha=0.5, Labeling Ratio=20%2026.02 | 77.13 | — | — | — | — | |
| SuperFedNASBillion MACs=1.45-2.452026.01 | 77.09 | — | — | — | — | |
| SuperFedNASBillion MACs=2.45-3.752026.01 | 77.09 | — | — | — | — | |
| DeepFedNASBillion MACs=0.45-0.952026.01 | 77.04 | — | — | — | — | |
| SuperFedNASBillion MACs=0.95-1.452026.01 | 76.53 | — | — | — | — | |
| FedDurealpha=0.1, Labeling Ratio=20%2026.02 | 76.21 | — | — | — | — | |
| FixMatch-GPLalpha=0.1, Labeling Ratio=20%2026.02 | 76.14 | — | — | — | — | |
| FedProx+FixMatchalpha=1, Labeling Ratio=20%2026.02 | 76.06 | — | — | — | — | |
| FixMatch-LPLalpha=1, Labeling Ratio=20%2026.02 | 76.03 | — | — | — | — | |
| FedAvg+FlexMatchalpha=1, Labeling Ratio=20%2026.02 | 75.95 | — | — | — | — | |
| FedAvg+FlexMatchalpha=0.5, Labeling Ratio=20%2026.02 | 75.75 | — | — | — | — | |
| SuperFedNASBillion MACs=0.45-0.952026.01 | 75.69 | — | — | — | — | |
| FedDBalpha=1, Labeling Ratio=20%2026.02 | 75.65 | — | — | — | — | |
| FedProx+FixMatchalpha=0.5, Labeling Ratio=20%2026.02 | 75.15 | — | — | — | — | |
| FixMatch-LPLalpha=0.5, Labeling Ratio=20%2026.02 | 75.14 | — | — | — | — | |
| FedDBalpha=0.5, Labeling Ratio=20%2026.02 | 75 | — | — | — | — | |
| FedDBalpha=0.1, Labeling Ratio=20%2026.02 | 74.18 | — | — | — | — | |
| FedAvg+FlexMatchalpha=0.1, Labeling Ratio=20%2026.02 | 73.32 | — | — | — | — | |
| FixMatch-LPLalpha=0.1, Labeling Ratio=20%2026.02 | 72.51 | — | — | — | — | |
| FedProx+FixMatchalpha=0.1, Labeling Ratio=20%2026.02 | 72.36 | — | — | — | — | |
| FedMatchalpha=1, Labeling Ratio=20%2026.02 | 72.34 | — | — | — | — | |
| FedLabelalpha=1, Labeling Ratio=20%2026.02 | 72.22 | — | — | — | — | |
| pFedGP-IP-compute# clients=50, # samples/client=18002021.06 | 72 | — | — | — | — | |
| FedNASBillion MACs=2.45-3.752026.01 | 71.93 | — | — | — | — | |
| pFedGP# clients=50, # samples/client=18002021.06 | 71.8 | — | — | — | — | |
| FedLokealpha=1, Labeling Ratio=20%2026.02 | 71.78 | — | — | — | — | |
| FedLokealpha=0.5, Labeling Ratio=20%2026.02 | 71.61 | — | — | — | — | |
| pFedGP-IP-compute# clients=100, # samples/client=9002021.06 | 71.5 | — | — | — | — | |
| pFedGP# clients=100, # samples/client=9002021.06 | 71.3 | — | — | — | — | |
| FedLokealpha=0.1, Labeling Ratio=20%2026.02 | 70.63 | — | — | — | — | |
| FedPer# clients=50, # samples/client=18002021.06 | 70.6 | — | — | — | — | |
| pFedHN# clients=50, # samples/client=18002021.06 | 70.4 | — | — | — | — | |
| FedProxalpha=1, Labeling Ratio=20%2026.02 | 69.91 | — | — | — | — | |
| pFedMe# clients=50, # samples/client=18002021.06 | 69.9 | — | — | — | — | |
| pFedGP-IP-data# clients=50, # samples/client=18002021.06 | 69.8 | — | — | — | — | |
| FedProxalpha=0.5, Labeling Ratio=20%2026.02 | 69.57 | — | — | — | — | |
| pFedHN# clients=100, # samples/client=9002021.06 | 69.4 | — | — | — | — | |
| FedAvgalpha=1, Labeling Ratio=20%2026.02 | 69.21 | — | — | — | — | |
| pFedMe# clients=100, # samples/client=9002021.06 | 68.9 | — | — | — | — | |
| FedMatchalpha=0.5, Labeling Ratio=20%2026.02 | 68.6 | — | — | — | — | |
| FedPer# clients=100, # samples/client=9002021.06 | 68.4 | — | — | — | — | |
| pFedGP-IP-data# clients=100, # samples/client=9002021.06 | 68.3 | — | — | — | — | |
| FedAvgalpha=0.5, Labeling Ratio=20%2026.02 | 68.29 | — | — | — | — | |
| pFedGP-IP-compute# clients=500, # samples/client=1802021.06 | 68.2 | — | — | — | — | |
| pFedGP# clients=500, # samples/client=1802021.06 | 68.1 | — | — | — | — | |
| pFedGP-IP-data# clients=500, # samples/client=1802021.06 | 67.6 | — | — | — | — | |
| FedLabelalpha=0.5, Labeling Ratio=20%2026.02 | 67.3 | — | — | — | — | |
| FedMatchalpha=0.1, Labeling Ratio=20%2026.02 | 66.94 | — | — | — | — | |
| FedAvgalpha=0.1, Labeling Ratio=20%2026.02 | 66.24 | — | — | — | — | |
| FedPNASBillion MACs=0.95-1.452026.01 | 65.74 | — | — | — | — | |
| FedProxalpha=0.1, Labeling Ratio=20%2026.02 | 65.53 | — | — | — | — | |
| FedAvgBillion MACs=2.45-3.752026.01 | 65.02 | — | — | — | — | |
| FedPNASBillion MACs=0.45-0.952026.01 | 64.3 | — | — | — | — | |
| pFedHN# clients=500, # samples/client=1802021.06 | 64.2 | — | — | — | — | |
| SFLModel=ResNet-18, C=2, K=52023.11 | 64.17 | — | — | — | — | |
| SFLModel=ResNet-18, C=2, K=52023.11 | 64.17 | — | — | — | — | |
| FedAvgBillion MACs=1.45-2.452026.01 | 64 | — | — | — | — | |
| FedAvgBillion MACs=0.95-1.452026.01 | 63 | — | — | — | — | |
| FedPer# clients=500, # samples/client=1802021.06 | 62.2 | — | — | — | — | |
| FedAvgBillion MACs=0.45-0.952026.01 | 61.76 | — | — | — | — | |
| Local# clients=50, # samples/client=18002021.06 | 61.1 | — | — | — | — | |
| SFLModel=VGG-9, C=2, K=52023.11 | 60.82 | — | — | — | — | |
| SFLModel=VGG-9, C=2, K=52023.11 | 60.82 | — | — | — | — | |
| SFLModel=ResNet-18, C=1, K=52023.11 | 60.36 | — | — | — | — | |
| SFLModel=ResNet-18, C=1, K=52023.11 | 60.36 | — | — | — | — | |
| FedLabelalpha=0.1, Labeling Ratio=20%2026.02 | 60.13 | — | — | — | — | |
| FedNASBillion MACs=1.45-2.452026.01 | 59.97 | — | — | — | — | |
| LG-FedAvg# clients=100, # samples/client=9002021.06 | 59.9 | — | — | — | — | |
| SFLModel=VGG-9, C=2, K=202023.11 | 59.78 | — | — | — | — | |
| SFLModel=VGG-9, C=2, K=202023.11 | 59.78 | — | — | — | — | |
| LG-FedAvg# clients=50, # samples/client=18002021.06 | 59.5 | — | — | — | — | |
| FedU# clients=50, # samples/client=18002021.06 | 59.3 | — | — | — | — | |
| SFLModel=VGG-9, C=1, K=52023.11 | 59.11 | — | — | — | — | |
| SFLModel=VGG-9, C=1, K=52023.11 | 59.11 | — | — | — | — | |
| pFedMe# clients=500, # samples/client=1802021.06 | 58.8 | — | — | — | — | |
| SFLModel=VGG-9, C=1, K=202023.11 | 58.71 | — | — | — | — | |
| SFLModel=VGG-9, C=1, K=202023.11 | 58.71 | — | — | — | — | |
| FedNASBillion MACs=0.45-0.952026.01 | 58.15 | — | — | — | — | |
| SFLModel=ResNet-18, C=2, K=202023.11 | 58.05 | — | — | — | — |