Classification on Digits (test)
89.91Average AccuracyFed-CO2
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Fed-CO2Feature Skew=true2023.12 | 89.91 | 77.56 | 88.68 | 87.84 | 97.78 | 97.66 | — | — | — | |
| COPAFeature Skew=true2023.12 | 86.75 | 72.9 | 85.52 | 83.08 | 95.99 | 96.27 | — | — | — | |
| FedRoDFeature Skew=true2023.12 | 86.26 | 71.5 | 85.51 | 81.79 | 96.42 | 96.09 | — | — | — | |
| FedPerFeature Skew=true2023.12 | 85.22 | 67.61 | 83.88 | 81.89 | 96.53 | 96.21 | — | — | — | |
| FedBNFeature Skew=true2023.12 | 85.2 | 71.04 | 83.19 | 78.33 | 96.97 | 96.57 | — | — | — | |
| MOONFeature Skew=true2023.12 | 84.05 | 65.48 | 82.89 | 80.57 | 95.05 | 96.25 | — | — | — | |
| FedAvgFeature Skew=true2023.12 | 82.7 | 62.86 | 82.27 | 76.85 | 95.56 | 95.87 | — | — | — | |
| FedProxFeature Skew=true2023.12 | 82.7 | 63.08 | 82.34 | 76.64 | 95.58 | 95.75 | — | — | — | |
| FedAvg + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 82.36 | 63.54 | 74.73 | — | 94.12 | 97.05 | 13.84 | — | — | |
| FedDyn + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 82.31 | 63.34 | 74.83 | — | 94.02 | 97.07 | 13.88 | — | — | |
| FedProto + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 82.21 | 63.7 | 73.83 | — | 94.12 | 97.19 | 13.96 | — | — | |
| FedNTD + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 82.13 | 63.57 | 73.53 | — | 94.32 | 97.08 | 14.06 | — | — | |
| SingleSetFeature Skew=true2023.12 | 82 | 65.25 | 80.31 | 77.77 | 95.16 | 94.38 | — | — | — | |
| FedFABackbone=CLIP+MLP2025.03 | 80.76 | 57.87 | 75.53 | — | 92.97 | 96.68 | 15.44 | — | — | |
| FedOPT + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 80.75 | 62.35 | 70.75 | — | 93.47 | 96.43 | 14.54 | — | — | |
| SCAFFOLD + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 80.7 | 63.25 | 71.54 | — | 92.08 | 95.91 | 13.69 | — | — | |
| FEDGENBackbone=CLIP+MLP2025.03 | 80.19 | 58.77 | 73.62 | — | 92.52 | 95.85 | 14.99 | — | — | |
| FedAvg + GGEURBackbone=CLIP+MLP, Optimization Step=Step 12025.03 | 80.18 | 58.55 | 73.13 | — | 93.02 | 96.02 | 15.28 | — | — | |
| FedDynBackbone=CLIP+MLP2025.03 | 79.19 | 58.89 | 70.3 | — | 92.13 | 95.46 | 15.19 | — | — | |
| FedNTDBackbone=CLIP+MLP2025.03 | 78.86 | 58.26 | 69.95 | — | 91.43 | 95.82 | 15.41 | — | — | |
| FedMixBackbone=CLIP+MLP2025.03 | 78.85 | 57.5 | 72.6 | — | 90.25 | 95.03 | 14.89 | — | — | |
| Ours (simulate-analyze-reduce)Backbone=ConvNet, Source Domain=MNIST2023.04 | 78.82 | 69.94 | 78.47 | 78.34 | 88.54 | — | — | — | — | |
| MOON + GGEURBackbone=CLIP+MLP, Optimization Step=Step 1 & 22025.03 | 78.13 | 55.23 | 71 | — | 91.13 | 95.16 | 16.08 | — | — | |
| SCAFFOLDBackbone=Standard2025.03 | 77.39 | 26.64 | 90.69 | — | 94.45 | 97.79 | 29.41 | — | — | |
| FedOPTBackbone=CLIP+MLP2025.03 | 77.12 | 58.65 | 66.47 | — | 88.79 | 94.57 | 14.96 | — | — | |
| SCAFFOLDBackbone=CLIP+MLP2025.03 | 76.93 | 54.33 | 68.71 | — | 90.08 | 94.62 | 16.31 | — | — | |
| FedProtoBackbone=CLIP+MLP2025.03 | 76.83 | 54.29 | 65.52 | — | 92.63 | 94.86 | 17.4 | — | — | |
| FedAvgBackbone=CLIP+MLP2025.03 | 76.6 | 56.36 | 65.17 | — | 89.74 | 95.12 | 16.25 | — | — | |
| Bipartite2025.02 | 76.4 | — | — | — | — | — | 0.245 | — | — | |
| FedOPTBackbone=Standard2025.03 | 74.89 | 31.32 | 87.92 | — | 87.62 | 92.71 | 25.38 | — | — | |
| PDENBackbone=ConvNet, Source Domain=MNIST2023.04 | 74.77 | 62.21 | 69.39 | 82.2 | 85.26 | — | — | — | — | |
| L2DBackbone=ConvNet, Source Domain=MNIST2023.04 | 74.46 | 62.86 | 63.72 | 87.3 | 83.97 | — | — | — | — | |
| FedCGS + SLOT-Alignalpha=0.05, Backbone=ViT-B/32, Alignment strength (tau)=0.42026.06 | 70.42 | 49.09 | 65.45 | — | 78.92 | 88.22 | 14.74 | — | — | |
| RSDA+ASRBackbone=ConvNet, Source Domain=MNIST2023.04 | 70.1 | 52.8 | 64.5 | 80.8 | 82.4 | — | — | — | — | |
| FedPFT + SLOT-Alignalpha=0.05, Backbone=ViT-B/32, Alignment strength (tau)=0.42026.06 | 69.39 | 50.77 | 67.02 | — | 73.99 | 85.77 | 12.67 | — | — | |
| RSDABackbone=ConvNet, Source Domain=MNIST2023.04 | 68.5 | 47.4 | 62 | 81.5 | 83.1 | — | — | — | — | |
| FedProtoBackbone=Standard2025.03 | 68.18 | 34.61 | 58 | — | 89.54 | 90.54 | 23.38 | — | — | |
| LOO2025.02 | 68 | — | — | — | — | — | 0.318 | — | — | |
| MOON + GGEURBackbone=CLIP+MLP, Optimization Step=Step 12025.03 | 67.5 | 43.04 | 60.35 | — | 81.96 | 84.64 | 16.97 | — | — | |
| FedCGSalpha=0.05, Backbone=ViT-B/322026.06 | 66.93 | 45.9 | 57.85 | — | 80.37 | 83.6 | 15.68 | — | — | |
| O-FedAvg + SLOT-Alignalpha=0.05, Backbone=ViT-B/32, Alignment strength (tau)=0.42026.06 | 66.9 | 56.8 | 59.15 | — | 71.2 | 80.45 | 9.54 | — | — | |
| RABackbone=ConvNet, Source Domain=MNIST2023.04 | 66.44 | 54.77 | 59.6 | 74.05 | 77.33 | — | — | — | — | |
| AME2025.02 | 66.2 | — | — | — | — | — | 0.324 | — | — | |
| O-FedAvgalpha=0.05, Backbone=ViT-B/322026.06 | 65.83 | 52.74 | 52.87 | — | 80.97 | 76.73 | 13.11 | — | — | |
| DataShap2025.02 | 64.9 | — | — | — | — | — | 0.335 | — | — | |
| BetaShap2025.02 | 64.7 | — | — | — | — | — | 0.332 | — | — | |
| Influence2025.02 | 64.6 | — | — | — | — | — | 0.346 | — | — | |
| FedPFTalpha=0.05, Backbone=ViT-B/322026.06 | 64.27 | 46.74 | 44.82 | — | 83.16 | 82.36 | 18.51 | — | — | |
| AABackbone=ConvNet, Source Domain=MNIST2023.04 | 62.72 | 45.23 | 64.52 | 60.53 | 80.62 | — | — | — | — | |
| Random2025.02 | 61.9 | — | — | — | — | — | 0.342 | — | — | |
| Banzhaf2025.02 | 61 | — | — | — | — | — | 0.361 | — | — | |
| MOONBackbone=CLIP+MLP2025.03 | 60.07 | 38.83 | 52.74 | — | 73.09 | 75.64 | 15.14 | — | — | |
| M-ADABackbone=ConvNet, Source Domain=MNIST2023.04 | 59.49 | 42.55 | 48.95 | 67.94 | 78.53 | — | — | — | — | |
| ME-ADABackbone=ConvNet, Source Domain=MNIST2023.04 | 59.32 | 42.56 | 50.39 | 63.27 | 81.04 | — | — | — | — | |
| FedDynBackbone=Standard2025.03 | 58.65 | 34.57 | 50.72 | — | 60.34 | 88.91 | 19.76 | — | — | |
| MOONBackbone=Standard2025.03 | 58.36 | 33.36 | 39.28 | — | 68.11 | 92.78 | 23.82 | — | — | |
| FedAvgBackbone=Standard2025.03 | 58.09 | 34.68 | 46.99 | — | 60.3 | 90.4 | 20.74 | — | — | |
| FedNTDBackbone=Standard2025.03 | 56.43 | 18.03 | 97.29 | — | 58.07 | 52.31 | 28.12 | — | — | |
| GUDBackbone=ConvNet, Source Domain=MNIST2023.04 | 54.62 | 35.51 | 45.32 | 60.41 | 77.26 | — | — | — | — | |
| JiGenBackbone=ConvNet, Source Domain=MNIST2023.04 | 53.14 | 33.8 | 43.79 | 57.8 | 77.15 | — | — | — | — | |
| d-SNEBackbone=ConvNet, Source Domain=MNIST2023.04 | 52.05 | 26.22 | 37.83 | 50.98 | 93.16 | — | — | — | — | |
| ERMBackbone=ConvNet, Source Domain=MNIST2023.04 | 49.29 | 27.83 | 39.65 | 52.72 | 76.94 | — | — | — | — | |
| CCSABackbone=ConvNet, Source Domain=MNIST2023.04 | 49.05 | 25.89 | 37.31 | 49.29 | 83.72 | — | — | — | — | |
| DVRL2025.02 | 42.2 | — | — | — | — | — | 0.367 | — | — | |
| DataOob2025.02 | 33.8 | — | — | — | — | — | 0.349 | — | — | |
| ArrowFlowN=5620, Feat=64, Cls=10, ArrowFlow Config=[256] e=64 p=1 lr=0.22026.04 | — | — | — | — | — | — | — | — | 4.6 | |
| ClementsMesh=64x64, Epochs=200, Seeds=52025.12 | — | — | — | — | — | — | — | 94.055 | — | |
| Clements BellMesh=64x64, Epochs=200, Seeds=52025.12 | — | — | — | — | — | — | — | 91.77 | — | |
| FEDAMPNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 78.2 | — | |
| FEDAMPNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 75.1 | — | |
| FEDAVGNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 61 | — | |
| FEDAVGNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 55.5 | — | |
| FedCCANumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 78.2 | — | |
| FedCCANumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 76.8 | — | |
| FEDDANNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 70.2 | — | |
| FEDDANNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 64.2 | — | |
| FEDDANNNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 72.8 | — | |
| FEDDANNNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 64.3 | — | |
| FEDMCNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 78 | — | |
| FEDMCNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 75.2 | — | |
| FEDPROXNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 38.4 | — | |
| FEDPROXNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 50.3 | — | |
| FEDREPNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 79.5 | — | |
| FEDREPNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 75.8 | — | |
| FEDSRNumber of classes per client (N)=22026.01 | — | — | — | — | — | — | — | 79.3 | — | |
| FEDSRNumber of classes per client (N)=52026.01 | — | — | — | — | — | — | — | 76.5 | — | |
| FldzhyanMesh=64x64, Epochs=200, Seeds=52025.12 | — | — | — | — | — | — | — | 92.16 | — | |
| Fldzhyan BellMesh=64x64, Epochs=200, Seeds=52025.12 | — | — | — | — | — | — | — | 92.66 | — | |
| KNNN=5620, Feat=64, Cls=102026.04 | — | — | — | — | — | — | — | — | 2.2 | |
| MLPN=5620, Feat=64, Cls=102026.04 | — | — | — | — | — | — | — | — | 1.9 | |
| RFN=5620, Feat=64, Cls=102026.04 | — | — | — | — | — | — | — | — | 2.8 | |
| SVMN=5620, Feat=64, Cls=102026.04 | — | — | — | — | — | — | — | — | 1.7 | |
| XGBN=5620, Feat=64, Cls=102026.04 | — | — | — | — | — | — | — | — | 4.2 |