Backdoor Defense on CIFAR-10 non-IID (test)
85.97Clean MAFoolsgold
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Foolsgoldbackbone=ResNet9, distribution=non-IID2025.03 | 85.97 | 20.24 | 68.91 | 83.27 | 16.14 | 42.2 | 50.79 | 63.56 | 31.62 | 3.77 | 78.08 | 1.49 | 80.22 | 42.88 | 62.45 | — | |
| FedAvgbackbone=ResNet9, distribution=non-IID2025.03 | 85.05 | 42.34 | 51.6 | 86.33 | 13.22 | 42.24 | 49.63 | 71.64 | 25.26 | 42.29 | 48.76 | 76.63 | 20.73 | 53.57 | 36.29 | — | |
| FedAvg*backbone=ResNet9, distribution=non-IID2025.03 | 85.05 | 1.78 | 83.09 | 1.78 | 83.09 | 1.78 | 83.09 | 1.78 | 83.09 | 1.78 | 83.09 | 1.78 | 83.09 | 1.78 | 83.09 | — | |
| Lockdownbackbone=ResNet9, distribution=non-IID2025.03 | 84.05 | 6.68 | 75.23 | 8.01 | 75.73 | 7.11 | 76.63 | 6.03 | 75.77 | 1.24 | 73.82 | 2.19 | 73.81 | 5.21 | 75.07 | — | |
| AlignInsbackbone=ResNet9, distribution=non-IID2025.03 | 83.77 | 2.48 | 81.17 | 1.7 | 81.32 | 1.54 | 81.24 | 1.1 | 81.11 | 2.73 | 81.54 | 2.08 | 80.42 | 1.77 | 80.48 | — | |
| Multi-metrics (MM)backbone=ResNet9, distribution=non-IID2025.03 | 82.02 | 50.52 | 41.41 | 95.7 | 4.08 | 66.88 | 28.18 | 43.69 | 47.38 | 85.58 | 13.02 | 98.86 | 1.04 | 63.12 | 30.83 | — | |
| RFAbackbone=ResNet9, distribution=non-IID2025.03 | 79.8 | 56.26 | 36.49 | 97.42 | 2.3 | 53.7 | 39 | 90.7 | 8.1 | 4.29 | 71.93 | 22.26 | 56.6 | 50.27 | 39.36 | — | |
| AlignInsSetting=cross-device FL, Attack=Badnet, Total clients=100, Clients per round=202025.03 | 79.51 | — | — | — | — | — | — | — | — | — | — | — | — | 1.9 | 7,928 | 75.81 | |
| LockdownSetting=cross-device FL, Attack=Badnet, Total clients=100, Clients per round=202025.03 | 73.91 | — | — | — | — | — | — | — | — | — | — | — | — | 99.92 | 0 | 0.06 | |
| MKrumbackbone=ResNet9, distribution=non-IID2025.03 | 70.89 | 72.7 | 20.98 | 95.57 | 3.71 | 2.12 | 69.8 | 53.81 | 35.09 | 1.18 | 74.02 | 1.22 | 71.08 | 49.58 | 37.78 | — | |
| FoolsgoldSetting=cross-device FL, Attack=Badnet, Total clients=100, Clients per round=202025.03 | 67.97 | — | — | — | — | — | — | — | — | — | — | — | — | 99.99 | 1 | 0 | |
| RLRbackbone=ResNet9, distribution=non-IID2025.03 | 59.87 | 3.27 | 55.54 | 0.94 | 55.53 | 1.98 | 59.98 | 1.87 | 59.52 | 0.21 | 45.6 | 0.27 | 46.02 | 1.92 | 53.04 | — | |
| RLRSetting=cross-device FL, Attack=Badnet, Total clients=100, Clients per round=202025.03 | 41.56 | — | — | — | — | — | — | — | — | — | — | — | — | 14.12 | 4,678 | 38.17 |