Regression on PovertyMap WILDS 2.0 (OOD)
0.55Worst U/R CorrOkapi
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OkapiVariant=Ours2022.11 | 0.55 | 0.33 | |
| OkapiVariant=no calipers2022.11 | 0.54 | 0.36 | |
| ERMSource=Our re-run2022.11 | 0.53 | 0.35 | |
| ERMSource=WILDS benchmark [63]2022.11 | 0.49 | — | |
| CORAL + SDGBase Algorithm=CORAL, Optimization=SDG2023.08 | 0.49 | — | |
| FISH + SDGBase Algorithm=FISH, Optimization=SDG2023.08 | 0.46 | — | |
| ERMBase Algorithm=ERM2023.08 | 0.45 | — | |
| CORALBase Algorithm=CORAL2023.08 | 0.44 | — | |
| CORAL + AND-MASKBase Algorithm=CORAL, Optimization=AND-MASK2023.08 | 0.44 | — | |
| CORAL + SAND-MASKBase Algorithm=CORAL, Optimization=SAND-MASK2023.08 | 0.44 | — | |
| FISHBase Algorithm=FISH2023.08 | 0.35 | — | |
| FixMatchSource=Our re-run2022.11 | 0.34 | 0.88 | |
| FixMatchSource=WILDS benchmark [63]2022.11 | 0.3 | — |