Classification on Waterbirds (test)
98.2Test AccuracyGB ERM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GB ERMGroup Info Train=true, Group Info Val=true2026.06 | 98.2 | — | 89.98 | |
| CB ERMGroup Info Train=false, Group Info Val=false2026.06 | 97.97 | — | 81.15 | |
| LfFGroup Info Train=false, Group Info Val=true2026.06 | 97.5 | — | 75.2 | |
| DFRGroup Info Train=false, Group Info Val=true2026.06 | 96.7 | — | 92.1 | |
| EIILGroup Info Train=false, Group Info Val=false2026.06 | 96.5 | — | 77.2 | |
| CPTGroup Info=Yes, Venue=ICML 242026.06 | 96.3 | — | 93.5 | |
| SASGroup Info=No, Venue=ICLR 252026.06 | 96.3 | — | 89.7 | |
| C-AdapterGroup Info=No, Venue=NeurIPS 222026.06 | 96.2 | — | 86.9 | |
| GEORGEGroup Info Train=false, Group Info Val=false2026.06 | 95.7 | — | 76.2 | |
| PPAGroup Info=No, Venue=CVPR 252026.06 | 94.6 | — | 87.2 | |
| JTTGroup Info Train=false, Group Info Val=true2026.06 | 93.6 | — | 86 | |
| GroupDROGroup Info Train=true, Group Info Val=true2026.06 | 93.5 | — | 91.4 | |
| JTTGroup Info=No, Venue=ICML 212026.06 | 93.3 | — | 86.7 | |
| D2CPGroup Info=No2026.06 | 93.06 | — | 90.81 | |
| MaskTuneGroup Info=No, Venue=NeurIPS 222026.06 | 93 | — | 86.4 | |
| TCSL-CS (ERM)Group Info Train=false, Group Info Val=false2026.06 | 92.83 | — | 91.91 | |
| PDEGroup Info=Yes, Venue=NeurIPS 232026.06 | 92.4 | — | 90.3 | |
| PDE+EIRepGroup Info=Yes, Venue=AISTATS 252026.06 | 91.6 | — | 90.4 | |
| ULAGroup Info Train=false, Group Info Val=true2026.06 | 91.5 | — | 86.1 | |
| uLAGroup Info=No, Venue=NeurIPS 232026.06 | 91.5 | — | 86.1 | |
| CNCGroup Info Train=false, Group Info Val=true2026.06 | 90.9 | — | 88.5 | |
| CNCGroup Info=No, Venue=ICML 222026.06 | 90.9 | — | 88.5 | |
| GroupDRO (with Tgt)Group label=✓2026.01 | 90.6 | — | — | |
| Group DROGroup Info=Yes, Venue=ICLR 202026.06 | 90.2 | — | 86.5 | |
| GICGroup Info=No, Venue=ICML 242026.06 | 89.6 | — | 86.3 | |
| XRMGroup Info=No, Venue=ICML 242026.06 | 89.3 | — | 88.1 | |
| Ours (ERM)Group label=×2026.01 | 87.3 | — | — | |
| *Ours (ERM)Group label=×2026.01 | 83.3 | — | — | |
| GroupDROGroup label=✓2026.01 | 61.4 | — | — | |
| MCDGroup label=×2026.01 | 59 | — | — | |
| PDEGroup label=✓2026.01 | 57.1 | — | — | |
| ICONGroup label=×2026.01 | 54.2 | — | — | |
| CORALGroup label=×2026.01 | 50.9 | — | — | |
| STARGroup label=×2026.01 | 49.8 | — | — | |
| ERM (Src-only)Group label=×2026.01 | 48.4 | — | — | |
| ATDOCGroup label=×2026.01 | 47.3 | — | — | |
| CDANGroup label=×2026.01 | 46.2 | — | — | |
| MK-MMDGroup label=×2026.01 | 45.1 | — | — | |
| DRSTGroup label=×2026.01 | 37.1 | — | — | |
| DANNGroup label=×2026.01 | 35.8 | — | — | |
| CAMLAcquisition Function=Random, Backbone=ResNet-182026.05 | — | 57.8 | — | |
| CAMLAcquisition Function=Confidence, Backbone=ResNet-182026.05 | — | 65.5 | — | |
| CAMLAcquisition Function=CoreSet, Backbone=ResNet-182026.05 | — | 64.3 | — | |
| CAMLAcquisition Function=BADGE, Backbone=ResNet-182026.05 | — | 69 | — | |
| CRMGroup Info=Yes, Venue=ICML 252026.06 | — | — | 86 | |
| GERNEGroup Info=No, Venue=ICCV 252026.06 | — | — | 89.88 | |
| LCGroup Info Train=false, Group Info Val=true2026.06 | — | — | 90.5 | |
| ShuffleAcquisition Function=Random, Backbone=ResNet-182026.05 | — | 43.8 | — | |
| ShuffleAcquisition Function=Confidence, Backbone=ResNet-182026.05 | — | 49.6 | — | |
| ShuffleAcquisition Function=CoreSet, Backbone=ResNet-182026.05 | — | 46.9 | — | |
| ShuffleAcquisition Function=BADGE, Backbone=ResNet-182026.05 | — | 39.1 | — |