Image Classification on FEMNIST (test)
97.31AccuracyQuPeD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| QuPeDPrecision=Full Precision (FP), Model=CNN12021.07 | 97.31 | — | — | |
| Per-FedAvgPrecision=Full Precision (FP), Model=CNN12021.07 | 97.16 | — | — | |
| QuPeDPrecision=2 Bits, Model=CNN12021.07 | 96.73 | — | — | |
| pFedMePrecision=Full Precision (FP), Model=CNN12021.07 | 96.6 | — | — | |
| Federated MLPrecision=Full Precision (FP), Model=CNN12021.07 | 96.32 | — | — | |
| QuPeLPrecision=2 Bits, Model=CNN12021.07 | 96.1 | — | — | |
| QuPeDPrecision=1 Bit, Model=CNN12021.07 | 95.15 | — | — | |
| QuPeDBackbone=CNN1, Quantization=FP2021.07 | 94.93 | — | — | |
| FedAvgPrecision=Full Precision (FP), Model=CNN12021.07 | 94.92 | — | — | |
| Local TrainingPrecision=Full Precision (FP), Model=CNN12021.07 | 94.86 | — | — | |
| QuPeDBackbone=CNN1, Quantization=2 Bits2021.07 | 94.56 | — | — | |
| QuPeLPrecision=1 Bit, Model=CNN12021.07 | 94.06 | — | — | |
| Local TrainingPrecision=2 Bits, Model=CNN12021.07 | 93.95 | — | — | |
| pFedMeBackbone=CNN1, Quantization=FP2021.07 | 93.7 | — | — | |
| Local TrainingPrecision=1 Bit, Model=CNN12021.07 | 93 | — | — | |
| Federated MLBackbone=CNN1, Quantization=FP2021.07 | 92.73 | — | — | |
| QuPeDBackbone=CNN1, Quantization=1 Bit2021.07 | 92.52 | — | — | |
| Per-FedAvgBackbone=CNN1, Quantization=FP2021.07 | 92.1 | — | — | |
| FedAvgBackbone=CNN1, Quantization=FP2021.07 | 91.3 | — | — | |
| FedEM2021.08 | 79.9 | — | — | |
| FedAvgPrivacy Budget=-, Backbone=CNN2025.03 | 79.22 | — | 77.79 | |
| FedAvg2021.08 | 78.6 | — | — | |
| D-FedEMtopology=Binomial Erdős-Rényi graph (p=0.5), communication=fully decentralized2021.08 | 77.2 | — | — | |
| FedSVAPrivacy Budget=0.5, Backbone=CNN2025.03 | 76.06 | — | 74.43 | |
| FedAvg+2021.08 | 75.3 | — | — | |
| FedSVAPrivacy Budget=0.4, Backbone=CNN2025.03 | 75.3 | — | 73.88 | |
| pFedMe2021.08 | 74.9 | — | — | |
| KTA v2Comm. (MB)=94.62025.11 | 74.5 | — | — | |
| FedAvgComm. (MB)=154.32025.11 | 74.3 | — | — | |
| FedProxComm. (MB)=154.32025.11 | 74.1 | — | — | |
| FedSVAPrivacy Budget=0.3, Backbone=CNN2025.03 | 73.79 | — | 73.18 | |
| Clustered FL2021.08 | 73.5 | — | — | |
| FedSVAPrivacy Budget=0.2, Backbone=CNN2025.03 | 73.19 | — | 71.93 | |
| DPA DPPrivacy Budget=0.5, Backbone=CNN2025.03 | 73.18 | — | 72.5 | |
| TV DPPrivacy Budget=0.5, Backbone=CNN2025.03 | 72.63 | — | 72.39 | |
| DPA DPPrivacy Budget=0.3, Backbone=CNN2025.03 | 72.25 | — | 71.75 | |
| DPA DPPrivacy Budget=0.4, Backbone=CNN2025.03 | 72.25 | — | 71.92 | |
| Sens DPPrivacy Budget=0.5, Backbone=CNN2025.03 | 72.21 | — | 72.05 | |
| TV DPPrivacy Budget=0.4, Backbone=CNN2025.03 | 71.95 | — | 71.83 | |
| Sens DPPrivacy Budget=0.4, Backbone=CNN2025.03 | 71.72 | — | 71.69 | |
| NbAFLPrivacy Budget=0.5, Backbone=CNN2025.03 | 71.55 | — | 71.28 | |
| TV DPPrivacy Budget=0.3, Backbone=CNN2025.03 | 71.35 | — | 69.22 | |
| NbAFLPrivacy Budget=0.4, Backbone=CNN2025.03 | 71.33 | — | 70.85 | |
| Sens DPPrivacy Budget=0.3, Backbone=CNN2025.03 | 71.22 | — | 71.03 | |
| Local2021.08 | 71 | — | — | |
| DPA DPPrivacy Budget=0.2, Backbone=CNN2025.03 | 70.79 | — | 69.57 | |
| pFedBreD (mg)+AMModel Type=Personalized, Backbone=DNN, AM=true2022.11 | 70.34 | — | — | |
| pFedBreD (mg)+FTModel Type=Personalized, Backbone=DNN, Fine-tuning=true2022.11 | 67.8 | — | — | |
| Sens DPPrivacy Budget=0.2, Backbone=CNN2025.03 | 67.33 | — | 68.92 | |
| FedAMPModel Type=Personalized, Backbone=DNN2022.11 | 66.75 | — | — | |
| NbAFLPrivacy Budget=0.3, Backbone=CNN2025.03 | 66.16 | — | 62.49 | |
| Per-FedAvg+AMModel Type=Personalized, Backbone=DNN, AM=true2022.11 | 66.03 | — | — | |
| FedCCANumber of classes per client (N)=32026.01 | 65.3 | — | — | |
| pFedBreD (mg)Model Type=Personalized, Backbone=DNN2022.11 | 65.29 | — | — | |
| FEDSRNumber of classes per client (N)=32026.01 | 65.1 | — | — | |
| FEDMCNumber of classes per client (N)=32026.01 | 64.8 | — | — | |
| FEDREPNumber of classes per client (N)=32026.01 | 64.6 | — | — | |
| Per-FedAvg+FTModel Type=Personalized, Backbone=DNN, Fine-tuning=true2022.11 | 63.99 | — | — | |
| Per-FedAvgModel Type=Personalized, Backbone=DNN2022.11 | 61.57 | — | — | |
| FEDAMPNumber of classes per client (N)=32026.01 | 60.7 | — | — | |
| pFedBreD (mg)+AMModel Type=Personalized, Backbone=MCLR, AM=true2022.11 | 60.64 | — | — | |
| pFedMe+AMModel Type=Personalized, Backbone=DNN, AM=true2022.11 | 60.46 | — | — | |
| pFedBreD (mg)+FTModel Type=Global, Backbone=DNN, Fine-tuning=true2022.11 | 60.16 | — | — | |
| pFedBreD (mg)Model Type=Global, Backbone=DNN2022.11 | 60.08 | — | — | |
| FedAMPModel Type=Personalized, Backbone=MCLR2022.11 | 60.04 | — | — | |
| FedAvg+AMModel Type=Global, Backbone=DNN, AM=true2022.11 | 60.03 | — | — | |
| pFedBreD (mg)+FTModel Type=Personalized, Backbone=MCLR, Fine-tuning=true2022.11 | 59.82 | — | — | |
| pFedBreD (mg)+AMModel Type=Global, Backbone=DNN, AM=true2022.11 | 59.53 | — | — | |
| Per-FedAvg+AMModel Type=Global, Backbone=DNN, AM=true2022.11 | 59.34 | — | — | |
| Per-FedAvg+AMModel Type=Personalized, Backbone=MCLR, AM=true2022.11 | 58.17 | — | — | |
| FedAvgModel Type=Global, Backbone=DNN2022.11 | 57.94 | — | — | |
| pFedMe+AMModel Type=Global, Backbone=DNN, AM=true2022.11 | 57.7 | — | — | |
| Per-FedAvg+FTModel Type=Global, Backbone=DNN, Fine-tuning=true2022.11 | 57.12 | — | — | |
| pFedMe+AMModel Type=Personalized, Backbone=MCLR, AM=true2022.11 | 56.91 | — | — | |
| FEDDANNNumber of classes per client (N)=32026.01 | 56.9 | — | — | |
| pFedBreD (mg)Model Type=Personalized, Backbone=MCLR2022.11 | 56.38 | — | — | |
| Per-FedAvgModel Type=Global, Backbone=DNN2022.11 | 56.3 | — | — | |
| pFedBreD (mg)+AMModel Type=Global, Backbone=MCLR, AM=true2022.11 | 56.23 | — | — | |
| pFedMeModel Type=Global, Backbone=DNN2022.11 | 56.2 | — | — | |
| Per-FedAvg+AMModel Type=Global, Backbone=MCLR, AM=true2022.11 | 56.16 | — | — | |
| FedAvg+AMModel Type=Global, Backbone=MCLR, AM=true2022.11 | 56.07 | — | — | |
| pFedMe+FTModel Type=Global, Backbone=DNN, Fine-tuning=true2022.11 | 55.89 | — | — | |
| Per-FedAvg+FTModel Type=Personalized, Backbone=MCLR, Fine-tuning=true2022.11 | 55.41 | — | — | |
| pFedBreD (mg)Model Type=Global, Backbone=MCLR2022.11 | 55.38 | — | — | |
| FEDDANNumber of classes per client (N)=32026.01 | 55.3 | — | — | |
| pFedBreD (mg)+FTModel Type=Global, Backbone=MCLR, Fine-tuning=true2022.11 | 55.1 | — | — | |
| pFedMeModel Type=Personalized, Backbone=DNN2022.11 | 54.72 | — | — | |
| Per-FedAvgModel Type=Personalized, Backbone=MCLR2022.11 | 54.34 | — | — | |
| pFedMe+AMModel Type=Global, Backbone=MCLR, AM=true2022.11 | 54.13 | — | — | |
| FedAvgModel Type=Global, Backbone=MCLR2022.11 | 53.96 | — | — | |
| TV DPPrivacy Budget=0.2, Backbone=CNN2025.03 | 53.88 | — | 50.92 | |
| pFedMe+FTModel Type=Personalized, Backbone=DNN, Fine-tuning=true2022.11 | 53.79 | — | — | |
| Per-FedAvg+FTModel Type=Global, Backbone=MCLR, Fine-tuning=true2022.11 | 53.69 | — | — | |
| Per-FedAvgModel Type=Global, Backbone=MCLR2022.11 | 53.3 | — | — | |
| pFedMe+FTModel Type=Personalized, Backbone=MCLR, Fine-tuning=true2022.11 | 52.16 | — | — | |
| pFedMeModel Type=Personalized, Backbone=MCLR2022.11 | 51.7 | — | — | |
| pFedMeModel Type=Global, Backbone=MCLR2022.11 | 50.49 | — | — | |
| pFedMe+FTModel Type=Global, Backbone=MCLR, Fine-tuning=true2022.11 | 50.1 | — | — | |
| LocalComm. (MB)=02025.11 | 45.2 | — | — | |
| FedEMModel Type=Global, Backbone=DNN2022.11 | 43.96 | — | — |