Image Classification on CIFAR-10 (Performance vs. Percentile Thresholds)
88.27Performance at 60% ThresholdFedAvg
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FedAvgalpha=2, # Clean Clients=102026.04 | 88.27 | — | — | — | — | — | — | |
| FedAvgalpha=0.5, # Clean Clients=102026.04 | 86.81 | — | — | — | — | — | — | |
| FedSIRalpha=2, # Clean Clients=32026.04 | 84.95 | 85.72 | 85.23 | 85.19 | 84.76 | 84.26 | 84.4 | |
| FedNoRoalpha=2, # Clean Clients=32026.04 | 83.8 | 84.93 | 84.51 | 83.97 | 83.26 | 82.5 | 82.59 | |
| FedSIRalpha=0.5, # Clean Clients=32026.04 | 83.55 | 84.13 | 83.96 | 83.94 | 83.45 | 83.56 | 83.15 | |
| FedELCalpha=2, # Clean Clients=32026.04 | 83.11 | 84 | 83.54 | 83.62 | 82.94 | 82.42 | 79.73 | |
| FedELCalpha=0.5, # Clean Clients=32026.04 | 82.28 | 82.85 | 82.45 | 82.84 | 82.12 | 81.86 | 77.74 | |
| Pruningalpha=2, # Clean Clients=32026.04 | 82.23 | — | — | — | — | — | — | |
| FedNedalpha=2, # Clean Clients=32026.04 | 81.78 | 82.27 | 81.95 | 81.15 | 81.25 | 81.44 | 81 | |
| FedAvgalpha=2, # Clean Clients=32026.04 | 81.67 | 84.61 | 83.73 | 82.23 | 78.94 | 73.55 | 40.9 | |
| FedNoRoalpha=0.5, # Clean Clients=32026.04 | 81.55 | 82.65 | 81.86 | 81.73 | 81.43 | 80.86 | 81.41 | |
| FedProxalpha=2, # Clean Clients=32026.04 | 80.31 | 83.98 | 82.7 | 81.06 | 78.73 | 72.94 | 39.24 | |
| Pruningalpha=0.5, # Clean Clients=32026.04 | 78.7 | — | — | — | — | — | — | |
| FedSIRalpha=0.1, # Clean Clients=52026.04 | 78.31 | 78.65 | 78.42 | 78.1 | 77.93 | 77.93 | 77.9 | |
| FedELCalpha=0.1, # Clean Clients=52026.04 | 77.88 | 77.71 | 78.18 | 78.07 | 77.29 | 78.43 | 77.72 | |
| FedAvgalpha=0.5, # Clean Clients=32026.04 | 77.35 | 83.14 | 81.56 | 80.78 | 71.63 | 62.42 | 40.24 | |
| FedProxalpha=0.5, # Clean Clients=32026.04 | 77.25 | 82.21 | 80.64 | 79.29 | 75.88 | 64.53 | 37.64 | |
| FedNedalpha=0.5, # Clean Clients=32026.04 | 77.22 | 77.16 | 77.87 | 77.25 | 76.95 | 76.78 | 76.59 | |
| Pruningalpha=0.1, # Clean Clients=52026.04 | 76.91 | — | — | — | — | — | — | |
| FedNoRoalpha=0.1, # Clean Clients=52026.04 | 76.73 | 77.65 | 76.56 | 76.47 | 76.8 | 76.83 | 76.11 | |
| FedCorralpha=2, # Clean Clients=32026.04 | 76.65 | 78.48 | 77.34 | 76.81 | 75.84 | 75.46 | 74.97 | |
| FedAvgalpha=0.1, # Clean Clients=102026.04 | 76.34 | — | — | — | — | — | — | |
| FedNedalpha=0.1, # Clean Clients=52026.04 | 74.11 | 74.16 | 72.44 | 74.6 | 73.29 | 73.83 | 73.12 | |
| FedAvgalpha=0.1, # Clean Clients=52026.04 | 73.6 | 73.67 | 73.62 | 71.92 | 73.21 | 70.39 | 68.9 | |
| RoFLalpha=2, # Clean Clients=32026.04 | 73.56 | 78.51 | 77.69 | 74.69 | 71.83 | 69.36 | 69.39 | |
| FedProxalpha=0.1, # Clean Clients=52026.04 | 72.65 | 73.14 | 72.53 | 71.6 | 72.11 | 71.24 | 68.72 | |
| FedCorralpha=0.5, # Clean Clients=32026.04 | 71.73 | 75.23 | 73.48 | 72.95 | 67.8 | 65.58 | 64.37 | |
| FedLSRalpha=2, # Clean Clients=32026.04 | 70.27 | 73.68 | 73.87 | 72.43 | 68.63 | 64.64 | 56.12 | |
| FedLSRalpha=0.5, # Clean Clients=32026.04 | 67.06 | 71.67 | 68.53 | 69.19 | 63.54 | 59.06 | 51.94 | |
| FedLSRalpha=0.1, # Clean Clients=52026.04 | 63.7 | 64.82 | 63.99 | 61.81 | 61.38 | 63.43 | 61.68 | |
| RoFLalpha=0.5, # Clean Clients=32026.04 | 59.82 | 71.18 | 67.27 | 59.28 | 61.6 | 54.98 | 56.46 | |
| RHFLalpha=2, # Clean Clients=32026.04 | 55.66 | 63.28 | 61.15 | 58.18 | 49.81 | 35.47 | 25.82 | |
| FedCorralpha=0.1, # Clean Clients=52026.04 | 55.12 | 62.46 | 60.62 | 57.28 | 54.49 | 53.46 | 52.02 | |
| RoFLalpha=0.1, # Clean Clients=52026.04 | 42.81 | 43.73 | 44.13 | 44.45 | 35.76 | 43.96 | 40.75 | |
| RHFLalpha=0.5, # Clean Clients=32026.04 | 40.07 | 48.37 | 44.91 | 41.95 | 36.34 | 27.62 | 22.34 | |
| RHFLalpha=0.1, # Clean Clients=52026.04 | 24.98 | 27.72 | 27.51 | 26.61 | 25.01 | 22.37 | 20.56 |