Image Classification on SVHN (test) (Accuracy and Calibration Error Metrics)
97.31AccuracyBrier
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BrierBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 97.31 | 1.32 | 2.18 | 1.07 | |
| Socrates+MSBackbone=VGG-162026.04 | 97.3 | 0.56 | 1.01 | 0.97 | |
| Socrates+VSBackbone=VGG-162026.04 | 97.27 | 0.63 | 1.15 | 0.96 | |
| SocratesBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 97.25 | 2.49 | 2.39 | 1.06 | |
| SocratesBackbone=VGG-162026.04 | 97.25 | 2.49 | 2.39 | 1.06 | |
| Socrates+TSBackbone=VGG-162026.04 | 97.24 | 6.91 | 6.88 | 1.21 | |
| SATBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 97.21 | 0.6 | 0.74 | 1.07 | |
| CE+TSBackbone=VGG-162026.04 | 97.2 | 1.57 | 1.54 | 1.09 | |
| CEBackbone=VGG-162026.04 | 97.19 | 1.58 | 1.58 | 1.05 | |
| CE+VSBackbone=VGG-162026.04 | 97.19 | 0.76 | 0.96 | 1.07 | |
| CE+MSBackbone=VGG-162026.04 | 97.16 | 0.71 | 0.96 | 1.07 | |
| RIC2026.04 | 95.86 | 0.018 | — | — | |
| RIC2026.04 | 95.86 | 0.018 | — | — | |
| SL2026.04 | 95.8 | 0.033 | — | — | |
| SL2026.04 | 95.8 | 0.033 | — | — | |
| PonderNet2026.04 | 95.79 | 0.033 | — | — | |
| PonderNet2026.04 | 95.79 | 0.033 | — | — | |
| ACT2026.04 | 95.68 | 0.033 | — | — | |
| ACT2026.04 | 95.68 | 0.033 | — | — | |
| PA3Fedω=1.0, heterogeneity=standard2025.05 | 92.13 | — | — | — | |
| Mosaicω=1.0, heterogeneity=standard2025.05 | 91.79 | — | — | — | |
| FedOptω=1.0, heterogeneity=standard2025.05 | 91.6 | — | — | — | |
| FedInitω=1.0, heterogeneity=standard2025.05 | 91.55 | — | — | — | |
| FedAFω=1.0, heterogeneity=standard2025.05 | 91.45 | — | — | — | |
| pFedFDAω=1.0, heterogeneity=standard2025.05 | 90.94 | — | — | — | |
| DFRDω=1.0, heterogeneity=standard2025.05 | 90.55 | — | — | — | |
| FedKFDω=1.0, heterogeneity=standard2025.05 | 90.44 | — | — | — | |
| FedRSω=1.0, heterogeneity=standard2025.05 | 90.08 | — | — | — | |
| FedFTGω=1.0, heterogeneity=standard2025.05 | 89.66 | — | — | — | |
| DENSEω=1.0, heterogeneity=standard2025.05 | 89.54 | — | — | — | |
| Mosaicω=1.0, heterogeneity=stronger2025.05 | 89.1 | — | — | — | |
| FedAvgω=1.0, heterogeneity=standard2025.05 | 89.01 | — | — | — | |
| FedRSω=1.0, heterogeneity=stronger2025.05 | 83.84 | — | — | — | |
| FedInitω=1.0, heterogeneity=stronger2025.05 | 82.85 | — | — | — | |
| Mosaicω=0.1, heterogeneity=standard2025.05 | 82.11 | — | — | — | |
| pFedFDAω=1.0, heterogeneity=stronger2025.05 | 81.82 | — | — | — | |
| FedAFω=1.0, heterogeneity=stronger2025.05 | 81.76 | — | — | — | |
| PA3Fedω=0.1, heterogeneity=standard2025.05 | 81.69 | — | — | — | |
| FLSDBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 81.62 | 2.31 | 2.16 | 2.08 | |
| DFRDω=1.0, heterogeneity=stronger2025.05 | 81.61 | — | — | — | |
| FedOptω=1.0, heterogeneity=stronger2025.05 | 81.45 | — | — | — | |
| FedKFDω=1.0, heterogeneity=stronger2025.05 | 81.25 | — | — | — | |
| PA3Fedω=1.0, heterogeneity=stronger2025.05 | 80.62 | — | — | — | |
| DENSEω=1.0, heterogeneity=stronger2025.05 | 80.58 | — | — | — | |
| Mosaicω=0.1, heterogeneity=stronger2025.05 | 80.47 | — | — | — | |
| pFedFDAω=0.1, heterogeneity=standard2025.05 | 80.13 | — | — | — | |
| FedAFω=0.1, heterogeneity=standard2025.05 | 79.89 | — | — | — | |
| FedInitω=0.1, heterogeneity=standard2025.05 | 79.8 | — | — | — | |
| FedAvgω=1.0, heterogeneity=stronger2025.05 | 79.73 | — | — | — | |
| DFRDω=0.1, heterogeneity=standard2025.05 | 79.65 | — | — | — | |
| FedFTGω=1.0, heterogeneity=stronger2025.05 | 79.64 | — | — | — | |
| FedOptω=0.1, heterogeneity=standard2025.05 | 78.78 | — | — | — | |
| FedRSω=0.1, heterogeneity=standard2025.05 | 77.39 | — | — | — | |
| FedKFDω=0.1, heterogeneity=standard2025.05 | 77.03 | — | — | — | |
| DENSEω=0.1, heterogeneity=standard2025.05 | 76.91 | — | — | — | |
| FedFTGω=0.1, heterogeneity=standard2025.05 | 76.64 | — | — | — | |
| FedAvgω=0.1, heterogeneity=standard2025.05 | 75.37 | — | — | — | |
| ASADPRECThroughput=1, Speedup=1.332026.06 | 69.65 | — | — | — | |
| SyncSingle2026.06 | 69.44 | — | — | — | |
| SyncMulti2026.06 | 69.28 | — | — | — | |
| FocalBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 66.08 | 4.77 | 4.72 | 3.2 | |
| Mosaicω=0.01, heterogeneity=standard2025.05 | 52.28 | — | — | — | |
| Mosaicω=0.01, heterogeneity=stronger2025.05 | 51.11 | — | — | — | |
| PA3Fedω=0.01, heterogeneity=standard2025.05 | 45.5 | — | — | — | |
| pFedFDAω=0.01, heterogeneity=standard2025.05 | 44.49 | — | — | — | |
| FedInitω=0.01, heterogeneity=standard2025.05 | 43.67 | — | — | — | |
| FedAFω=0.01, heterogeneity=standard2025.05 | 42.98 | — | — | — | |
| DFRDω=0.01, heterogeneity=standard2025.05 | 42.42 | — | — | — | |
| PA3Fedω=0.1, heterogeneity=stronger2025.05 | 41.69 | — | — | — | |
| pFedFDAω=0.1, heterogeneity=stronger2025.05 | 41.47 | — | — | — | |
| DFRDω=0.1, heterogeneity=stronger2025.05 | 41.36 | — | — | — | |
| FedOptω=0.01, heterogeneity=standard2025.05 | 40.56 | — | — | — | |
| FedAFω=0.1, heterogeneity=stronger2025.05 | 40.56 | — | — | — | |
| FedInitω=0.1, heterogeneity=stronger2025.05 | 40.23 | — | — | — | |
| FedRSω=0.1, heterogeneity=stronger2025.05 | 39.87 | — | — | — | |
| FedKFDω=0.01, heterogeneity=standard2025.05 | 39.48 | — | — | — | |
| FedOptω=0.1, heterogeneity=stronger2025.05 | 38.68 | — | — | — | |
| FedRSω=0.01, heterogeneity=standard2025.05 | 38.59 | — | — | — | |
| FedFTGω=0.01, heterogeneity=standard2025.05 | 38.59 | — | — | — | |
| FedKFDω=0.1, heterogeneity=stronger2025.05 | 38.52 | — | — | — | |
| DENSEω=0.01, heterogeneity=standard2025.05 | 38.07 | — | — | — | |
| DENSEω=0.1, heterogeneity=stronger2025.05 | 37.95 | — | — | — | |
| FedAvgω=0.01, heterogeneity=standard2025.05 | 37.77 | — | — | — | |
| FedFTGω=0.1, heterogeneity=stronger2025.05 | 37.36 | — | — | — | |
| FedAvgω=0.1, heterogeneity=stronger2025.05 | 36.7 | — | — | — | |
| MCBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 35.06 | 2.7 | 2.7 | 5.06 | |
| PA3Fedω=0.01, heterogeneity=stronger2025.05 | 21.83 | — | — | — | |
| pFedFDAω=0.01, heterogeneity=stronger2025.05 | 20.52 | — | — | — | |
| CCL-SCBackbone=VGG-16, Training Protocol=standard, Epochs=3002026.04 | 19.59 | 0.57 | 0.57 | 6.47 | |
| FedInitω=0.01, heterogeneity=stronger2025.05 | 19.03 | — | — | — | |
| FedAFω=0.01, heterogeneity=stronger2025.05 | 18.88 | — | — | — | |
| DFRDω=0.01, heterogeneity=stronger2025.05 | 18.08 | — | — | — | |
| FedKFDω=0.01, heterogeneity=stronger2025.05 | 16.69 | — | — | — | |
| FedRSω=0.01, heterogeneity=stronger2025.05 | 15.92 | — | — | — | |
| FedOptω=0.01, heterogeneity=stronger2025.05 | 15.58 | — | — | — | |
| FedFTGω=0.01, heterogeneity=stronger2025.05 | 15.5 | — | — | — | |
| FedAvgω=0.01, heterogeneity=stronger2025.05 | 14.88 | — | — | — | |
| DENSEω=0.01, heterogeneity=stronger2025.05 | 14.37 | — | — | — |