Image Classification on Spawrious M2M-Hard
92.4Accuracy (M2M-Hard)OpenCLIP ZS prompt (full)
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenCLIP ZS prompt (full)Backbone=ViT-L-14, Feature Extractor=OpenCLIP, Evaluation=Zero-shot prompt2026.06 | 92.4 | |
| DFRBackbone=ViT-G (1.1B), Note=Requires group labels2026.06 | 88 | |
| A2 cross-modelBackbone=ViT-S x ViT-L, Feature Extractor=DINOv22026.06 | 87.1 | |
| Full only (518^2 image)Backbone=ViT-L (300M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 86.7 | |
| DFR + A2Backbone=ViT-S (21M), Note=Requires group labels2026.06 | 86.2 | |
| DFRBackbone=ViT-L (300M), Note=Requires group labels2026.06 | 86.1 | |
| DFRBackbone=ViT-B (86M), Note=Requires group labels2026.06 | 84.9 | |
| Attending on Attention (A2)Backbone=ViT-B (86M), Feature Extractor=DINOv22026.06 | 83.8 | |
| Attending on Attention (A2)Backbone=ViT-L (300M), Feature Extractor=DINOv22026.06 | 83.5 | |
| Full only (518^2 image)Backbone=ViT-B (86M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 82.4 | |
| Attending on Attention (A2)Backbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 82.4 | |
| Full onlyBackbone=ViT-L (300M), Feature Extractor=DINOv22026.06 | 81.9 | |
| Attending on Attention (A2)Backbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 80.6 | |
| Full onlyBackbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 79.7 | |
| DFRBackbone=ViT-S (21M), Note=Requires group labels2026.06 | 73.4 | |
| Full onlyBackbone=ViT-B (86M), Feature Extractor=DINOv22026.06 | 73.4 | |
| Full only (518^2 image)Backbone=ViT-S (21M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 72.6 | |
| CausIRLBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 68.93 | |
| Center CropBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 68.4 | |
| CORALBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 67.97 | |
| Full onlyBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 66.6 | |
| MMD + ORDEREDBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=ORDERED2026.05 | 62.1 | |
| Center CropBackbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 61.4 | |
| IRMBackbone=ResNet-50, Training Dataset=Spawrious, Note=Requires group labels2026.06 | 60.93 | |
| GroupDROBackbone=ResNet-50, Training Dataset=Spawrious, Note=Requires group labels2026.06 | 60.86 | |
| Scaling on ScalesBackbone=ViT-S (21M), Feature Extractor=DINOv2, scales=[1, 2]2026.06 | 60 | |
| ERMBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 58.7 | |
| CDAN + ELSBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 56.1 | |
| CDAN + SDATBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 53 | |
| MMD + k-means++Backbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=k-means++2026.05 | 52.5 | |
| Full onlyBackbone=ViT-L-14, Feature Extractor=OpenCLIP2026.06 | 50.6 | |
| CORAL + ORDEREDBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=ORDERED2026.05 | 50.5 | |
| CORAL + DPPBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=DPP2026.05 | 49.4 | |
| CORALBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 49.2 | |
| CORAL + k-means++Backbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=k-means++2026.05 | 48.6 | |
| MMDBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 48.1 | |
| MMD + VaRDASSBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=VaRDASS2026.05 | 48.1 | |
| CORAL + AnticlusteringBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=Anticlustering2026.05 | 47.5 | |
| CORAL + VaRDASSBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=VaRDASS2026.05 | 45.8 | |
| MMD + DPPBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=DPP2026.05 | 45.6 | |
| MMD + AnticlusteringBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=Anticlustering2026.05 | 44.6 | |
| CDANBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 44.3 | |
| ERMBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 43 | |
| MCCBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 42.7 | |
| ARMBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 41.7 | |
| DANNBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 39.8 | |
| Random CropsBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 22.1 |