Image Classification on F-MNIST
92.8AccuracyMirsadeghi et al. (2021)
Evaluation results
| Method | Links | |
|---|---|---|
| Mirsadeghi et al. (2021)Spike code=single, Architecture=20C5-P2-40C5-P2-1000-10, Neuron model=IF (PL-PSP)2022.05 | 92.8 | |
| FedAvgAttack=Attack-free2024.07 | 91.1 | |
| TrimAttack=Attack-free2024.07 | 91 | |
| MedianAttack=Attack-free2024.07 | 90.9 | |
| FedAvgAttack=Alternate2024.07 | 90.8 | |
| FedAvgAttack=Sybil2024.07 | 90.7 | |
| TrimAttack=Alternate2024.07 | 90.6 | |
| TrimAttack=Sybil2024.07 | 90.6 | |
| FLTrustAttack=Sybil2024.07 | 90.6 | |
| Mono-Forwardprediction_strategy=cumulative, reproduced=true2025.01 | 90.52 | |
| Mono-Forwardprediction_strategy=final-layer, reproduced=true2025.01 | 90.51 | |
| FLTrustAttack=Attack-free2024.07 | 90.5 | |
| MedianAttack=Alternate2024.07 | 90.4 | |
| MedianAttack=Sybil2024.07 | 90.4 | |
| BoBaAttack=Neurotoxin2024.07 | 90.4 | |
| FedAvgAttack=BadNet2024.07 | 90.3 | |
| TrimAttack=BadNet2024.07 | 90.3 | |
| BoBaAttack=BadNet2024.07 | 90.3 | |
| BoBaAttack=Sybil2024.07 | 90.3 | |
| BPreproduced=true2025.01 | 90.27 | |
| BoBaAttack=Attack-free2024.07 | 90.2 | |
| TrimAttack=Neurotoxin2024.07 | 90.2 | |
| Zhang et al. (2021)Spike code=single, Architecture=16C5-P2-32C5-P2-800-128-10, Neuron model=IF (ReL-PSP)2022.05 | 90.1 | |
| KrumAttack=Attack-free2024.07 | 90.1 | |
| FedAvgAttack=Neurotoxin2024.07 | 90.1 | |
| AGSDAttack=Attack-free2024.07 | 90 | |
| BoBaAttack=DBA2024.07 | 90 | |
| BoBaAttack=IBA2024.07 | 90 | |
| FRePoImg/Cls=50, Predictor=KRR2022.06 | 89.9 | |
| MESASAttack=Attack-free2024.07 | 89.9 | |
| FreqFedAttack=BadNet2024.07 | 89.9 | |
| MedianAttack=Neurotoxin2024.07 | 89.9 | |
| FreqFedAttack=Alternate2024.07 | 89.8 | |
| FreqFedAttack=Sybil2024.07 | 89.8 | |
| FreqFedAttack=Attack-free2024.07 | 89.7 | |
| FLTrustAttack=Alternate2024.07 | 89.7 | |
| BoBaAttack=Alternate2024.07 | 89.7 | |
| MedianAttack=DBA2024.07 | 89.7 | |
| FAUST2025.01 | 89.67 | |
| FRePoImg/Cls=50, Predictor=NN2022.06 | 89.6 | |
| FLTrustAttack=Neurotoxin2024.07 | 89.6 | |
| AGSDAttack=Neurotoxin2024.07 | 89.6 | |
| FedAvgAttack=IBA2024.07 | 89.6 | |
| KrumAttack=Alternate2024.07 | 89.5 | |
| TrimAttack=DBA2024.07 | 89.5 | |
| KrumAttack=Sybil2024.07 | 89.5 | |
| AGSDAttack=Sybil2024.07 | 89.5 | |
| MESASAttack=Neurotoxin2024.07 | 89.5 | |
| TrimAttack=IBA2024.07 | 89.5 | |
| FedAvgAttack=DBA2024.07 | 89.4 | |
| MESASAttack=Sybil2024.07 | 89.4 | |
| KrumAttack=Neurotoxin2024.07 | 89.4 | |
| FreqFedAttack=IBA2024.07 | 89.4 | |
| MESASAttack=Alternate2024.07 | 89.3 | |
| MedianAttack=BadNet2024.07 | 89.3 | |
| AGSDAttack=BadNet2024.07 | 89.3 | |
| MedianAttack=IBA2024.07 | 89.3 | |
| FreqFedAttack=Neurotoxin2024.07 | 89.2 | |
| FC-FF + GEreproduced=true2025.01 | 89.12 | |
| MESASAttack=BadNet2024.07 | 89.1 | |
| FreqFedAttack=DBA2024.07 | 89.1 | |
| MESASAttack=IBA2024.07 | 89.1 | |
| CONTRAAttack=Attack-free2024.07 | 89 | |
| AGSDAttack=Alternate2024.07 | 89 | |
| KrumAttack=IBA2024.07 | 89 | |
| AGSDAttack=IBA2024.07 | 89 | |
| MESASAttack=DBA2024.07 | 88.9 | |
| CONTRAAttack=Sybil2024.07 | 88.9 | |
| CONTRAAttack=IBA2024.07 | 88.9 | |
| DSAImg/Cls=50, Predictor=NN2022.06 | 88.8 | |
| FLTrustAttack=BadNet2024.07 | 88.7 | |
| AGSDAttack=DBA2024.07 | 88.7 | |
| FLTrustAttack=IBA2024.07 | 88.7 | |
| CONTRAAttack=Alternate2024.07 | 88.6 | |
| CCL2025.01 | 88.58 | |
| FC-FFreproduced=true2025.01 | 88.56 | |
| CONTRAAttack=Neurotoxin2024.07 | 88.5 | |
| Collab FF2025.01 | 88.4 | |
| MTTImg/Cls=50, Predictor=NN2022.06 | 88.3 | |
| FW-DTP2025.01 | 88.24 | |
| DMImg/Cls=50, Predictor=NN2022.06 | 88.2 | |
| Zhang et al. (2021)Spike code=single, Architecture=1000-10, Neuron model=IF (ReL-PSP)2022.05 | 88.1 | |
| KrumAttack=DBA2024.07 | 88.1 | |
| Kheradpisheh & Masquelier (2020)Spike code=single, Architecture=1000-10, Neuron model=IF2022.05 | 88 | |
| KIPImg/Cls=50, Predictor=NN2022.06 | 88 | |
| Vanilla FFreproduced=true2025.01 | 87.88 | |
| FFCM2025.01 | 87.67 | |
| FF + GEreproduced=true2025.01 | 87.64 | |
| FLTrustAttack=DBA2024.07 | 87.6 | |
| MTTImg/Cls=10, Predictor=NN2022.06 | 87.2 | |
| KIPImg/Cls=10, Predictor=NN2022.06 | 86.8 | |
| FRePoImg/Cls=10, Predictor=KRR2022.06 | 86.8 | |
| FRePoImg/Cls=10, Predictor=NN2022.06 | 86.2 | |
| FedAvgpercentage of attackers=0%, data distribution=dynamic client data distribution, attack type=gradient manipulation attack2024.05 | 86 | |
| DSAImg/Cls=10, Predictor=NN2022.06 | 84.8 | |
| DMImg/Cls=10, Predictor=NN2022.06 | 83.6 | |
| RFLPApercentage of attackers=0%, data distribution=dynamic client data distribution, attack type=gradient manipulation attack2024.05 | 83 | |
| RFLPApercentage of attackers=10%, data distribution=dynamic client data distribution, attack type=gradient manipulation attack2024.05 | 79 | |
| RFLPApercentage of attackers=20%, data distribution=dynamic client data distribution, attack type=gradient manipulation attack2024.05 | 79 | |
| FRePoImg/Cls=1, Predictor=KRR2022.06 | 77.1 |