Regression on PovertyMap (test)
0.7827Worst-U/R Pearson CorrelationFGDRO-KL-Adam
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FGDRO-KL-AdamBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7827 | 0.8225 | |
| FGDRO-CVaRBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7443 | 0.7977 | |
| FedProxBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7305 | 0.7641 | |
| FedAvgBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7301 | 0.7782 | |
| FedAdamBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7294 | 0.8273 | |
| FGDRO-KLBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7254 | 0.7829 | |
| SCAFFOLDBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7229 | 0.7814 | |
| DR-DSGDBackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7155 | 0.777 | |
| Oracle ERMModel Selection=Oracle2024.06 | 0.71 | — | |
| DRFABackbone=ResNet50, Communication interval (I)=32, Local mini-batch size=32, Iterations=20K2024.10 | 0.7071 | 0.7665 | |
| CLOVEModel Selection=Oracle2024.06 | 0.51 | — | |
| MC-PseudolabelModel Selection=Oracle2024.06 | 0.51 | — | |
| MC-PseudolabelModel Selection=ID2024.06 | 0.5 | — | |
| MC-PseudolabelModel Selection=Worst2024.06 | 0.5 | — | |
| ERMModel Selection=Oracle2024.06 | 0.49 | — | |
| MRIModel Selection=Oracle2024.06 | 0.49 | — | |
| ERMModel Selection=ID2024.06 | 0.48 | — | |
| ERMModel Selection=Worst2024.06 | 0.48 | — | |
| MRIModel Selection=ID2024.06 | 0.47 | — | |
| CLOVEModel Selection=ID2024.06 | 0.46 | — | |
| MRIModel Selection=Worst2024.06 | 0.46 | — | |
| IRMModel Selection=Oracle2024.06 | 0.45 | — | |
| REXModel Selection=Oracle2024.06 | 0.45 | — | |
| MIPModel Selection=Oracle2024.06 | 0.43 | — | |
| IB-IRMModel Selection=Oracle2024.06 | 0.43 | — | |
| REXModel Selection=ID2024.06 | 0.43 | — | |
| FishrModel Selection=Oracle2024.06 | 0.43 | — | |
| CLOVEModel Selection=Worst2024.06 | 0.42 | — | |
| REXModel Selection=Worst2024.06 | 0.42 | — | |
| FishrModel Selection=ID2024.06 | 0.42 | — | |
| GroupDROModel Selection=Oracle2024.06 | 0.42 | — | |
| FishrModel Selection=Worst2024.06 | 0.41 | — | |
| MIPModel Selection=ID2024.06 | 0.4 | — | |
| IRMModel Selection=Worst2024.06 | 0.39 | — | |
| MIPModel Selection=Worst2024.06 | 0.39 | — | |
| IB-IRMModel Selection=ID2024.06 | 0.39 | — | |
| IRMModel Selection=ID2024.06 | 0.38 | — | |
| GroupDROModel Selection=ID2024.06 | 0.38 | — | |
| IB-IRMModel Selection=Worst2024.06 | 0.37 | — | |
| GroupDROModel Selection=Worst2024.06 | 0.37 | — | |
| IDGMModel Selection=Oracle2024.06 | 0.13 | — | |
| IDGMModel Selection=ID2024.06 | 0.02 | — | |
| IDGMModel Selection=Worst2024.06 | 0.01 | — |