Image Classification on F-MNIST 30% Minority (test)
94.34Majority AccuracyCLIMB
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CLIMBImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 94.34 | 53.27 | 82.02 | |
| CLIMBImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 93 | 67.23 | 85.27 | |
| CLIMB + FedReLaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 92.3 | 75.47 | 87.25 | |
| MOONImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 91.13 | 44.43 | 77.12 | |
| FedProxImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 90.69 | 50 | 78.48 | |
| MOONImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 90.61 | 59.8 | 81.37 | |
| FedProxImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 90.6 | 60.07 | 81.44 | |
| FedAvgImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 90.44 | 50.5 | 78.46 | |
| CLIMB + FedReLaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 90.28 | 73.6 | 85.28 | |
| FedAvg + FedReLaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 90.17 | 70.5 | 84.27 | |
| FedAvgImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 89.86 | 60.67 | 81.1 | |
| MOON + FedReLaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 89.24 | 69.87 | 83.43 | |
| MOON + FedReLaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 88.63 | 74.77 | 84.47 | |
| FedNovaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 88.41 | 69.77 | 82.82 | |
| FedProx + FedReLaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 88.14 | 70.4 | 82.82 | |
| FedProx + FedReLaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 87.37 | 74.9 | 83.63 | |
| FedAvg + FedReLaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 87.33 | 75.7 | 83.84 | |
| FedNova + FedReLaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 87.27 | 77.9 | 84.46 | |
| FedNova + FedReLaImbalance Ratio (IR)=10, Heterogeneity level (α)=0.32026.06 | 86.83 | 76.17 | 83.63 | |
| FedNovaImbalance Ratio (IR)=20, Heterogeneity level (α)=0.32026.06 | 85.94 | 55.03 | 76.67 |