Binary Classification on Waterbirds (OOD)
98.9AccuracyiFAM (K=4)
Evaluation results
| Method | Links | |
|---|---|---|
| iFAM (K=4)Backbone=ViT-B (86M), Requires Group Labels=false2026.06 | 98.9 | |
| iFAM (K=8)Backbone=ViT-B (86M), Requires Group Labels=false2026.06 | 98.8 | |
| A^2_LR cross-modelBackbone (attn × emb)=ViT-S × ViT-G, Requires Group Labels=false2026.06 | 98.2 | |
| DFRBackbone=ViT-G (1.1B), Requires Group Labels=true2026.06 | 98.1 | |
| LR (full image)Backbone=ViT-G (1.1B), Requires Group Labels=false2026.06 | 97.8 | |
| DFRBackbone=ViT-B (86M), Requires Group Labels=true2026.06 | 95.5 | |
| A^2_LRBackbone (attn × emb)=ViT-S × ViT-S, Requires Group Labels=false2026.06 | 93 | |
| DFRBackbone=ViT-S (21M), Requires Group Labels=true2026.06 | 92.4 | |
| DFR† + A^2Backbone (attn × emb)=ViT-S × ViT-S, Requires Group Labels=true2026.06 | 91.9 | |
| LR (full image)Backbone=ViT-S (21M), Requires Group Labels=false2026.06 | 88.7 | |
| TTRBackbone=OpenCLIP ViT-L-14, Requires Group Labels=false2026.06 | 87.2 | |
| A^2_ZSBackbone (attn × emb)=ViT-S × OpenCLIP ViT-L-14, Requires Group Labels=false2026.06 | 80.3 | |
| OpenCLIP ZS (full image)Backbone=ViT-L-14, Requires Group Labels=false2026.06 | 73.5 | |
| CONBIASBackbone=ResNet-50, Pre-trained=ImageNet, Augmentation=CONBIAS2024.09 | 69.3 | |
| RandAugBackbone=ResNet-50, Pre-trained=ImageNet, Augmentation=RandAug2024.09 | 60.2 | |
| ALIABackbone=ResNet-50, Pre-trained=ImageNet, Augmentation=ALIA2024.09 | 48.2 | |
| CutMixBackbone=ResNet-50, Pre-trained=ImageNet, Augmentation=CutMix2024.09 | 45.6 | |
| BaselineBackbone=ResNet-50, Pre-trained=ImageNet2024.09 | 44.9 |