Group Robustness Classification on BREEDS Living-17
84WG ScoreERM Linear Probe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERM Linear ProbeBackbone=CLIP ViT-L/142022.07 | 84 | 98.6 | 14.6 | |
| WISE-FTBackbone=CLIP ViT-L/142022.07 | 84 | 98.6 | 14.6 | |
| DFR (Subsample)Backbone=CLIP ViT-L/142022.07 | 84 | 98.5 | 14.5 | |
| ERM AdapterBackbone=CLIP ViT-L/142022.07 | 82.7 | 98.2 | 15.5 | |
| Contrastive AdapterBackbone=CLIP ViT-L/142022.07 | 80 | 97.5 | 17.5 | |
| DFR (Upsample)Backbone=CLIP ViT-L/142022.07 | 78.7 | 97.3 | 18.6 | |
| ERM AdapterBackbone=CLIP ResNet-502022.07 | 70.7 | 94 | 23.3 | |
| Contrastive AdapterBackbone=CLIP ResNet-502022.07 | 62 | 90.9 | 28.9 | |
| ERM Linear ProbeBackbone=CLIP ResNet-502022.07 | 53.3 | 90.8 | 37.5 | |
| WISE-FTBackbone=CLIP ResNet-502022.07 | 53.3 | 90.8 | 37.5 | |
| Group Prompt ZSBackbone=CLIP ViT-L/142022.07 | 48 | 96.6 | 48.6 | |
| DFR (Subsample)Backbone=CLIP ResNet-502022.07 | 46.7 | 89.4 | 42.7 | |
| DFR (Upsample)Backbone=CLIP ResNet-502022.07 | 44 | 86.4 | 42.4 | |
| Group Prompt ZSBackbone=CLIP ResNet-502022.07 | 30 | 90.6 | 60.6 | |
| Zero-shot (ZS)Backbone=CLIP ResNet-502022.07 | 6 | 86.7 | 80.7 | |
| Zero-shot (ZS)Backbone=CLIP ViT-L/142022.07 | 4 | 86.6 | 82.6 |