Image Classification on Waterbirds 100% (test)
90.7Worst Group AccuracySCOREV
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SCOREVgroup annot.=true2026.05 | 90.7 | — | — | |
| DFRVgroup annot.=true2026.05 | 78.8 | — | — | |
| SCOREgroup annot.=false2026.05 | 76.7 | — | — | |
| SCOREusing group annotations=false2026.05 | 75.3 | 80.8 | — | |
| SCOREgroup annotation=false2026.05 | 75.3 | — | 80.8 | |
| PruSCusing group annotations=false, pruning threshold=10%2026.05 | 67.1 | 90.6 | — | |
| PruSCgroup annotation=false, pruning=10%2026.05 | 67.1 | — | 90.6 | |
| GroupDROusing group annotations=true2026.05 | 56.7 | 80.4 | — | |
| GroupDROgroup annotation=true2026.05 | 56.7 | — | 80.4 | |
| CLIPMode=Zero-shot2022.02 | 43.46 | 73.18 | — | |
| ResNet50using group annotations=false2026.05 | 36.5 | 74.9 | — | |
| ResNet50group annotation=false2026.05 | 36.5 | — | 74.9 | |
| DFRTrusing group annotations=true2026.05 | 34.7 | 80.3 | — | |
| DFRTrgroup annotation=true2026.05 | 34.7 | — | 80.3 | |
| CLIPMode=Finetune, LogisticReg.2022.02 | 32.15 | 68.36 | — | |
| JTTusing group annotations=false2026.05 | 25.4 | 78.5 | — | |
| JTTgroup annotation=false2026.05 | 25.4 | — | 78.5 |