Image Classification on EMNIST (test)
94.63AccuracyNon-private (SGD)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Non-private (SGD)Privacy=Non-private2026.02 | 94.63 | — | — | — | — | |
| PlainPre-training=Pre-Cifar100, Differential Privacy Status=Non-DP, Training Epochs=1002026.04 | 94.51 | — | — | — | — | |
| PlainPre-training=Pre-ImageNet, Differential Privacy Status=Non-DP, Training Epochs=1002026.04 | 94.26 | — | — | — | — | |
| Non-privateDirichlet alpha (α)=12026.02 | 94.2 | — | — | — | — | |
| PlainPre-training=Pre-ImageNet, Differential Privacy=False, Epochs=202026.04 | 94.12 | — | — | — | — | |
| PlainPre-training=Pre-Cifar100, Differential Privacy=False, Epochs=202026.04 | 93.75 | — | — | — | — | |
| Non-privateDirichlet alpha (α)=0.52026.02 | 93.59 | — | — | — | — | |
| COSMOSDirichlet heterogeneity alpha=1, Evaluation stage=Final-round2026.05 | 93.5 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=322022.03 | 93.19 | — | — | — | — | |
| FedIvon@meanprediction_type=point estimate based predictions evaluated at the mean of IVON posterior2024.11 | 93.14 | 0.0349 | 0.2821 | 0.1075 | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=322022.03 | 93.11 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=322022.03 | 93.1 | — | — | — | — | |
| FedIvonprediction_type=Monte Carlo averaging, samples=5002024.11 | 93.09 | 0.0188 | 0.2341 | 0.1019 | — | |
| LLPVATBackbone=ResNet18, Bag Size=322022.03 | 93.08 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=1282022.03 | 93.06 | — | — | — | — | |
| LLPVATBackbone=ResNet18, Bag Size=642022.03 | 92.99 | — | — | — | — | |
| LLPVATBackbone=ResNet18, Bag Size=1282022.03 | 92.99 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=642022.03 | 92.95 | — | — | — | — | |
| LLPVATBackbone=ResNet18, Bag Size=2562022.03 | 92.81 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=642022.03 | 92.8 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=642022.03 | 92.79 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=2562022.03 | 92.69 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=5122022.03 | 92.67 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=1282022.03 | 92.58 | — | — | — | — | |
| Non-privateDirichlet alpha (α)=0.32026.02 | 92.5 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=1282022.03 | 92.49 | — | — | — | — | |
| LLPVATBackbone=ResNet18, Bag Size=5122022.03 | 92.48 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=2562022.03 | 92.42 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=2562022.03 | 92.4 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=10242022.03 | 92.39 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=5122022.03 | 92.39 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=10242022.03 | 92.33 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=5122022.03 | 92.27 | — | — | — | — | |
| LLPVATBackbone=ResNet18, Bag Size=10242022.03 | 92.22 | — | — | — | — | |
| LLPFC-uniformArchitecture=VGG16, Bag size=20482022.03 | 92.2 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=10242022.03 | 92.06 | — | — | — | — | |
| LLPFC-approxArchitecture=VGG16, Bag size=20482022.03 | 92.05 | — | — | — | — | |
| FedAvg2024.11 | 91.66 | 0.0405 | 0.3355 | 0.1303 | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=322022.03 | 91.65 | — | — | — | — | |
| FedCTDirichlet heterogeneity alpha=1, Evaluation stage=Final-round2026.05 | 91.5 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=322022.03 | 91.46 | — | — | — | — | |
| LLPFC-uniformBackbone=ResNet18, Bag Size=322022.03 | 91.44 | — | — | — | — | |
| KLArchitecture=Wide ResNet-16-4, Bag Size=2562022.03 | 91.36 | — | — | — | — | |
| FedLaplace2024.11 | 91.33 | 0.0381 | 0.3255 | 0.1314 | — | |
| LLPVATBackbone=ResNet18, Bag Size=20482022.03 | 91.28 | — | — | — | — | |
| DittoK=100, S=10, r=0.12026.02 | 91.17 | — | — | — | — | |
| KLArchitecture=Wide ResNet-16-4, Bag Size=1282022.03 | 91.11 | — | — | — | — | |
| KLBackbone=ResNet18, Bag Size=20482022.03 | 91.06 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=322022.03 | 90.92 | — | — | — | — | |
| pFedFDAK=100, S=10, r=0.12026.02 | 90.86 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=642022.03 | 90.74 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=1282022.03 | 90.65 | — | — | — | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=642022.03 | 90.61 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=5122022.03 | 90.48 | — | — | — | — | |
| LLPVATArchitecture=Wide ResNet-16-4, Bag Size=642022.03 | 90.45 | — | — | — | — | |
| Non-privateDirichlet alpha (α)=0.12026.02 | 90.3 | — | — | — | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=1282022.03 | 90.15 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=20482022.03 | 90.07 | — | — | — | — | |
| WW-DP-SGDDirichlet alpha (α)=12026.02 | 90.02 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=642022.03 | 89.98 | — | — | — | — | |
| WW-DP-SGDPrivacy=Differential Privacy2026.02 | 89.96 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=2562022.03 | 89.93 | — | — | — | — | |
| ADP-AdamWDirichlet alpha (α)=12026.02 | 89.85 | — | — | — | — | |
| DP-Adam-ACDirichlet alpha (α)=12026.02 | 89.85 | — | — | — | — | |
| LLPFC-approxArchitecture=Wide ResNet-16-4, Bag Size=10242022.03 | 89.69 | — | — | — | — | |
| LLPFC-uniformBackbone=ResNet18, Bag Size=642022.03 | 89.54 | — | — | — | — | |
| FedAvg+FTK=100, S=10, r=0.12026.02 | 89.26 | — | — | — | — | |
| PPFEK=100, S=10, r=0.12026.02 | 89.04 | — | — | — | — | |
| DP-SATPrivacy=Differential Privacy2026.02 | 88.87 | — | — | — | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=5122022.03 | 88.86 | — | — | — | — | |
| ADP-AdamWPrivacy=Differential Privacy2026.02 | 88.85 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=1282022.03 | 88.74 | — | — | — | — | |
| DP-SGDPrivacy=Differential Privacy2026.02 | 88.65 | — | — | — | — | |
| DP-ISDirichlet alpha (α)=12026.02 | 88.44 | — | — | — | — | |
| VanillaRequires Retraining=No2026.06 | 88.4 | — | — | — | — | |
| WW-DP-SGDDirichlet alpha (α)=0.52026.02 | 88.25 | — | — | — | — | |
| DP-SGDDirichlet alpha (α)=12026.02 | 88.23 | — | — | — | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=20482022.03 | 88.17 | — | — | — | — | |
| DP-Adam-ACPrivacy=Differential Privacy2026.02 | 88.05 | — | — | — | — | |
| DP-AdamDirichlet alpha (α)=12026.02 | 88.04 | — | — | — | — | |
| LLPFC-uniformArchitecture=Wide ResNet-16-4, Bag Size=2562022.03 | 87.9 | — | — | — | — | |
| DP-Adam-ACDirichlet alpha (α)=0.52026.02 | 87.85 | — | — | — | — | |
| DP-SAMPrivacy=Differential Privacy2026.02 | 87.66 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=2562022.03 | 87.64 | — | — | — | — | |
| DP-SATDirichlet alpha (α)=12026.02 | 87.63 | — | — | — | — | |
| DP-SAMDirichlet alpha (α)=0.52026.02 | 87.55 | — | — | — | — | |
| WW-DP-SGDDirichlet alpha (α)=0.32026.02 | 87.5 | — | — | — | — | |
| DP-AdamPrivacy=Differential Privacy2026.02 | 87.45 | — | — | — | — | |
| LLPFC-uniformBackbone=ResNet18, Bag Size=1282022.03 | 87.44 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=10242022.03 | 87.36 | — | — | — | — | |
| ADP-AdamWDirichlet alpha (α)=0.52026.02 | 87.36 | — | — | — | — | |
| ADP-AdamWDirichlet alpha (α)=0.32026.02 | 87.35 | — | — | — | — | |
| DP-AdamDirichlet alpha (α)=0.52026.02 | 87.25 | — | — | — | — | |
| DP-SATDirichlet alpha (α)=0.32026.02 | 87.25 | — | — | — | — | |
| DP-SATDirichlet alpha (α)=0.52026.02 | 87.02 | — | — | — | — | |
| DP-ISPrivacy=Differential Privacy2026.02 | 86.95 | — | — | — | — | |
| DP-ISDirichlet alpha (α)=0.52026.02 | 86.93 | — | — | — | — | |
| DP-SAMDirichlet alpha (α)=0.32026.02 | 86.85 | — | — | — | — | |
| COMETDirichlet heterogeneity alpha=1, Evaluation stage=Final-round2026.05 | 86.8 | — | — | — | — | |
| LLPFC-approxBackbone=ResNet18, Bag Size=5122022.03 | 86.7 | — | — | — | — |