Domain Generalization on MetaShift Animals 8-class (test)
91.4Test AccuracyDFR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DFRBackbone=ViT-L (300M), Training=Requires group labels2026.06 | 91.4 | 77.9 | |
| DFRBackbone=ViT-G (1.1B), Training=Requires group labels2026.06 | 91.4 | 76.6 | |
| Full onlyBackbone=ViT-G (1.1B), Image Size=224^22026.06 | 90.6 | 75.9 | |
| OpenCLIP ZS prompt (full)Backbone=ViT-L-142026.06 | 90.4 | 58.8 | |
| DFRBackbone=ViT-B (86M), Training=Requires group labels2026.06 | 90.3 | 73.5 | |
| Full onlyBackbone=ViT-L (300M), Image Size=518^22026.06 | 90.1 | 77.6 | |
| Full onlyBackbone=ViT-L (300M), Image Size=224^22026.06 | 89.7 | 75.9 | |
| Full onlyBackbone=ViT-B (86M), Image Size=518^22026.06 | 89.6 | 72.7 | |
| Center CropBackbone=ViT-G (1.1B), Image Size=224^22026.06 | 89.2 | 72.4 | |
| DFR + A^2Backbone=ViT-S (21M), Training=Requires group labels2026.06 | 88.9 | 72.9 | |
| A^2 cross-modelBackbone=ViT-S x ViT-G, Evaluation Protocol=Averaged over 5 seeds2026.06 | 88.9 | 70.8 | |
| Full onlyBackbone=ViT-B (86M), Image Size=224^22026.06 | 88.3 | 70.3 | |
| DFRBackbone=ViT-S (21M), Training=Requires group labels2026.06 | 88.3 | 72 | |
| Attending on Attention (A^2)Backbone=ViT-G (1.1B), Evaluation Protocol=Averaged over 5 seeds2026.06 | 87.7 | 69.2 | |
| Full onlyBackbone=ViT-S (21M), Image Size=518^22026.06 | 87.5 | 68.3 | |
| Attending on Attention (A^2)Backbone=ViT-B (86M), Evaluation Protocol=Averaged over 5 seeds2026.06 | 87.5 | 67.9 | |
| Attending on Attention (A^2)Backbone=ViT-L (300M), Evaluation Protocol=Averaged over 5 seeds2026.06 | 85.2 | 69.1 | |
| Attending on Attention (A^2)Backbone=ViT-S (21M), Evaluation Protocol=Averaged over 5 seeds2026.06 | 85.1 | 67 | |
| Scaling on ScalesBackbone=ViT-S (21M), scales=[1, 2] 224^22026.06 | 84.7 | 65.5 | |
| Full onlyBackbone=ViT-S (21M), Image Size=224^22026.06 | 83.2 | 63.2 | |
| Center CropBackbone=ViT-S (21M), Image Size=224^22026.06 | 82.6 | 62.7 | |
| Random CropsBackbone=ViT-S (21M), Image Size=224^22026.06 | 58.3 | 34.6 |