Image Classification on Spawrious O2O-Hard
95.7AccuracyDFR
Evaluation Results
| Method | Links | |
|---|---|---|
| DFRBackbone=ViT-G (1.1B), Note=Requires group labels2026.06 | 95.7 | |
| DFR + A2Backbone=ViT-S (21M), Note=Requires group labels2026.06 | 95.2 | |
| DFRBackbone=ViT-L (300M), Note=Requires group labels2026.06 | 94.3 | |
| Attending on Attention (A2)Backbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 91 | |
| DFRBackbone=ViT-B (86M), Note=Requires group labels2026.06 | 90.1 | |
| OpenCLIP ZS prompt (full)Backbone=ViT-L-14, Feature Extractor=OpenCLIP, Evaluation=Zero-shot prompt2026.06 | 89.8 | |
| A2 cross-modelBackbone=ViT-S x ViT-L, Feature Extractor=DINOv22026.06 | 89.7 | |
| Attending on Attention (A2)Backbone=ViT-B (86M), Feature Extractor=DINOv22026.06 | 88.4 | |
| Full onlyBackbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 87.8 | |
| Full only (518^2 image)Backbone=ViT-L (300M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 86.3 | |
| Full only (518^2 image)Backbone=ViT-S (21M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 86.2 | |
| DFRBackbone=ViT-S (21M), Note=Requires group labels2026.06 | 86.1 | |
| MMD + AnticlusteringBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=Anticlustering2026.05 | 85.9 | |
| MMD + ORDEREDBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=ORDERED2026.05 | 85.1 | |
| Attending on Attention (A2)Backbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 83.1 | |
| Full only (518^2 image)Backbone=ViT-B (86M), Resolution=518x518, Feature Extractor=DINOv22026.06 | 82.5 | |
| Scaling on ScalesBackbone=ViT-S (21M), Feature Extractor=DINOv2, scales=[1, 2]2026.06 | 82.2 | |
| Attending on Attention (A2)Backbone=ViT-L (300M), Feature Extractor=DINOv22026.06 | 82.1 | |
| Full onlyBackbone=ViT-L (300M), Feature Extractor=DINOv22026.06 | 80.8 | |
| Full onlyBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 80.5 | |
| CausIRLBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 80.4 | |
| Center CropBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 80.2 | |
| CORALBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 79.65 | |
| CORAL + VaRDASSBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=VaRDASS2026.05 | 79.6 | |
| Full onlyBackbone=ViT-B (86M), Feature Extractor=DINOv22026.06 | 78.8 | |
| CORAL + ORDEREDBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=ORDERED2026.05 | 78.1 | |
| GroupDROBackbone=ResNet-50, Training Dataset=Spawrious, Note=Requires group labels2026.06 | 76.99 | |
| IRMBackbone=ResNet-50, Training Dataset=Spawrious, Note=Requires group labels2026.06 | 74.9 | |
| CDAN + SDATBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 73.7 | |
| CORAL + AnticlusteringBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=Anticlustering2026.05 | 73.7 | |
| MMD + VaRDASSBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=VaRDASS2026.05 | 72.7 | |
| Center CropBackbone=ViT-G (1.1B), Feature Extractor=DINOv22026.06 | 72.6 | |
| ERMBackbone=ResNet-50, Training Dataset=Spawrious2026.06 | 71.32 | |
| DANNBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 71.1 | |
| Full onlyBackbone=ViT-L-14, Feature Extractor=OpenCLIP2026.06 | 71 | |
| CDANBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 70.3 | |
| MMD + k-means++Backbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=k-means++2026.05 | 68.4 | |
| CORAL + DPPBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=DPP2026.05 | 67.8 | |
| CDAN + ELSBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 67.3 | |
| MMDBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 65.5 | |
| CORALBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 64.1 | |
| MMD + DPPBackbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=DPP2026.05 | 63.5 | |
| ERMBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 62.1 | |
| CORAL + k-means++Backbone=ResNet-18, Optimizer=Adam, Iterations=3000, Sampler=k-means++2026.05 | 61.4 | |
| ARMBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 60.6 | |
| MCCBackbone=ResNet-18, Optimizer=Adam, Iterations=30002026.05 | 54 | |
| Random CropsBackbone=ViT-S (21M), Feature Extractor=DINOv22026.06 | 38.2 |