Image Classification on TinyImageNet (test) (Accuracy and Wall Time)
0.1669Wall TimePDR+Krum
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PDR+KrumAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.1669 | 29.64 | |
| PDR+KrumAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.1669 | 29.64 | |
| PDR+KrumAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.1685 | 32.94 | |
| PDR+KrumAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.1685 | 32.94 | |
| PDR+KrumAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.1734 | — | |
| PDR+KrumAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.1734 | — | |
| PDR+KrumAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.1741 | — | |
| PDR+KrumAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.1741 | — | |
| PDR+KrumAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.1841 | 31.73 | |
| PDR+KrumAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.1841 | 31.73 | |
| PDR+KrumAttack Name=Sign-flip Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.1862 | 33.46 | |
| PDR+KrumAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.1862 | 33.46 | |
| PDR+KrumAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.1867 | 32.4 | |
| PDR+KrumAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.1867 | 32.4 | |
| PDR+BulyanAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.217 | 46.01 | |
| PDR+BulyanAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.217 | 42.74 | |
| PDR+BulyanAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.217 | 46.01 | |
| PDR+BulyanAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.217 | 42.74 | |
| PDR+MCAAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2185 | 54.3 | |
| PDR+MCAAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2185 | 54.3 | |
| PDR+MCAAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.224 | 54.64 | |
| PDR+MCAAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.224 | 54.64 | |
| PDR+MCAAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2249 | 54.3 | |
| PDR+MCAAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2249 | 54.3 | |
| PDR+BulyanAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.227 | — | |
| PDR+BulyanAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.227 | — | |
| PDR+BulyanAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2317 | 53.74 | |
| PDR+BulyanAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2317 | 53.74 | |
| PDR+MCAAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2341 | 53.8 | |
| PDR+MCAAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2341 | 53.8 | |
| PDR+BulyanAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2362 | 51.97 | |
| PDR+BulyanAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2362 | 51.97 | |
| PDR+KrumAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2373 | 32.71 | |
| PDR+KrumAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2373 | 32.71 | |
| PDR+Geometric MedianAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2392 | 54.54 | |
| PDR+Geometric MedianAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2392 | 54.54 | |
| PDR+BulyanAttack Name=Sign-flip Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2399 | 43.83 | |
| PDR+BulyanAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2399 | 43.83 | |
| PDR+MCAAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2415 | 48.73 | |
| PDR+MCAAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2415 | 48.73 | |
| PDR+Geometric MedianAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2447 | 54.12 | |
| PDR+Geometric MedianAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2447 | 54.12 | |
| PDR+Geometric MedianAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.2509 | 54.36 | |
| PDR+Geometric MedianAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.2509 | 54.36 | |
| PDR+MCAAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2529 | 54.72 | |
| PDR+MCAAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2529 | 54.72 | |
| PDR+BulyanAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2545 | 54.09 | |
| PDR+BulyanAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2545 | 54.09 | |
| PDR+MCAAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2613 | 54.43 | |
| PDR+MCAAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2613 | 54.43 | |
| PDR+Geometric MedianAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2642 | 50.44 | |
| PDR+Geometric MedianAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2642 | 50.44 | |
| PDR+BulyanAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2692 | 54.2 | |
| PDR+BulyanAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2692 | 54.2 | |
| PDR+Geometric MedianAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.2752 | 54.45 | |
| PDR+Geometric MedianAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.2752 | 54.45 | |
| PDR+Geometric MedianAttack Name=Sign-flip Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 0.3264 | — | |
| PDR+Geometric MedianAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 0.3264 | — | |
| PDR+Geometric MedianAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 0.3643 | 50.96 | |
| PDR+Geometric MedianAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 0.3643 | 50.96 | |
| MCAAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 1.1212 | 54.49 | |
| MCAAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 1.1212 | 54.49 | |
| MCAAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 1.1538 | 54.16 | |
| MCAAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 1.1538 | 54.16 | |
| MCAAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 1.1583 | 54.26 | |
| MCAAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 1.1583 | 54.26 | |
| MCAAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 1.1584 | 55 | |
| MCAAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 1.1584 | 55 | |
| MCAAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 1.1742 | 53.27 | |
| MCAAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 1.1742 | 53.27 | |
| PDR+Geometric MedianAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 1.3499 | — | |
| PDR+Geometric MedianAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 1.3499 | — | |
| MCAAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 1.3625 | 48.81 | |
| MCAAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 1.3625 | 48.81 | |
| MCAAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 1.3847 | 54.82 | |
| MCAAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 1.3847 | 54.82 | |
| Geometric MedianAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 2.856 | 51.25 | |
| Geometric MedianAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 2.856 | 51.25 | |
| Geometric MedianAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 2.8669 | 54.83 | |
| Geometric MedianAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 2.8669 | 54.83 | |
| Geometric MedianAttack Name=Gaussian Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 2.8878 | 54.33 | |
| Geometric MedianAttack Name=Gaussian Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 2.8878 | 54.33 | |
| Geometric MedianAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 2.8961 | 54.16 | |
| Geometric MedianAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 2.8961 | 54.16 | |
| Geometric MedianAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 2.9474 | 54.32 | |
| Geometric MedianAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 2.9474 | 54.32 | |
| Geometric MedianAttack Name=Sign-flip Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 3.8209 | — | |
| Geometric MedianAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 3.8209 | — | |
| Geometric MedianAttack Name=FoE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 5.0288 | 50.35 | |
| Geometric MedianAttack Name=FoE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 5.0288 | 50.35 | |
| KrumAttack Name=LIE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 8.6914 | 31.58 | |
| KrumAttack Name=LIE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 8.6914 | 31.58 | |
| KrumAttack Name=LIE Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 8.7 | 32.28 | |
| KrumAttack Name=LIE Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 8.7 | 32.28 | |
| KrumAttack Name=Gaussian Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 8.7092 | 32.15 | |
| KrumAttack Name=Gaussian Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 8.7092 | 32.15 | |
| KrumAttack Name=Sign-flip Attack, Malicious ratio (b)=0.1, beta=0.62026.05 | 8.7113 | 31.92 | |
| KrumAttack Name=Sign-flip Attack, Malicious client ratio (b)=0.1, Concentration parameter (beta)=0.62026.05 | 8.7113 | 31.92 | |
| KrumAttack Name=FoE Attack, Malicious ratio (b)=0.3, beta=0.62026.05 | 8.7311 | — | |
| KrumAttack Name=FoE Attack, Malicious client ratio (b)=0.3, Concentration parameter (beta)=0.62026.05 | 8.7311 | — |