Group Robustness Classification on CIFAR-10.02
87.5WGERM Linear Probe
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERM Linear ProbeBackbone=CLIP ViT-L/142022.07 | 87.5 | 96.1 | 8.6 | |
| WISE-FTBackbone=CLIP ViT-L/142022.07 | 87.5 | 97 | 9.5 | |
| ERM AdapterBackbone=CLIP ViT-L/142022.07 | 87 | 96.9 | 9.9 | |
| DFR (Subsample)Backbone=CLIP ViT-L/142022.07 | 85.5 | 96.6 | 11.1 | |
| Contrastive AdapterBackbone=CLIP ViT-L/142022.07 | 82.2 | 96.1 | 13.9 | |
| DFR (Upsample)Backbone=CLIP ViT-L/142022.07 | 72.5 | 93.8 | 21.3 | |
| Zero-shot (ZS)Backbone=CLIP ViT-L/142022.07 | 72 | 93.2 | 21.2 | |
| ERM AdapterBackbone=CLIP ResNet-502022.07 | 68.8 | 86 | 17.2 | |
| Contrastive AdapterBackbone=CLIP ResNet-502022.07 | 60.7 | 80.9 | 20.2 | |
| WISE-FTBackbone=CLIP ResNet-502022.07 | 58.2 | 79.1 | 20.9 | |
| ERM Linear ProbeBackbone=CLIP ResNet-502022.07 | 51.3 | 77.7 | 26.4 | |
| DFR (Subsample)Backbone=CLIP ResNet-502022.07 | 45 | 75 | 30 | |
| Zero-shot (ZS)Backbone=CLIP ResNet-502022.07 | 39.1 | 69.9 | 30.8 | |
| DFR (Upsample)Backbone=CLIP ResNet-502022.07 | 38.5 | 77.9 | 39.4 |