Image Classification on Spawrious (test)
95.8O2O Accuracy (Easy)MVT
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MVTBackbone=ViT-L2025.12 | 95.8 | 96.3 | 93.6 | 96.8 | 95.8 | 92.9 | 95.2 | — | — | — | — | — | — | — | — | |
| MVTBackbone=ViT-g2025.12 | 95.3 | 97.4 | 92.8 | 96.8 | 96.6 | 95.4 | 95.7 | — | — | — | — | — | — | — | — | |
| ViT-gBackbone=ViT-g2025.12 | 94.6 | 97 | 92.6 | 96.7 | 95.6 | 94.8 | 95.2 | — | — | — | — | — | — | — | — | |
| ViT-LBackbone=ViT-L2025.12 | 94.1 | 95.4 | 93.3 | 96.7 | 95 | 92.5 | 94.5 | — | — | — | — | — | — | — | — | |
| CnCGroup Info?=No, Train Twice?=Yes2025.08 | 90 | 73.5 | 81.3 | 82.8 | 62.5 | 78.7 | 78.1 | — | — | — | — | — | — | — | — | |
| GALSGroup Info?=No, Train Twice?=No2025.08 | 89.1 | 60 | 81 | 74 | 44.9 | 46.9 | 66 | — | — | — | — | — | — | — | — | |
| UWGroup Info?=Yes, Train Twice?=No2025.08 | 87.4 | 67.9 | 75.9 | 72.9 | 52.7 | 50.7 | 67.9 | — | — | — | — | — | — | — | — | |
| GroupDROGroup Info?=Yes, Train Twice?=No2025.08 | 86.7 | 67.2 | 76.4 | 74.3 | 55.7 | 49.9 | 68.3 | — | — | — | — | — | — | — | — | |
| SupERGroup Info?=No, Train Twice?=No2025.08 | 82.7 | 80.3 | 83.8 | 87.4 | 83.4 | 79.9 | 82.9 | — | — | — | — | — | — | — | — | |
| CVaR DROGroup Info?=No, Train Twice?=No2025.08 | 81.7 | 66.4 | 61.2 | 69.7 | 50.3 | 45.9 | 62.5 | — | — | — | — | — | — | — | — | |
| JTTGroup Info?=No, Train Twice?=Yes2025.08 | 80.9 | — | 59.7 | 71.2 | 49.7 | 45.2 | — | — | — | — | — | — | — | — | — | |
| DFRGroup Info?=Yes, Train Twice?=Yes2025.08 | 79.1 | 64.3 | 70 | 76.4 | 58.7 | 54.1 | 67.1 | — | — | — | — | — | — | — | — | |
| ERMGroup Info?=No, Train Twice?=No2025.08 | 78.4 | 63.4 | 71.1 | 72.9 | 52.7 | 50.7 | 64.9 | — | — | — | — | — | — | — | — | |
| IRMGroup Info?=Yes, Train Twice?=No2025.08 | 78.4 | 64.5 | 64.9 | 77.9 | 57.1 | 50.7 | 65.6 | — | — | — | — | — | — | — | — | |
| LfFGroup Info?=No, Train Twice?=No2025.08 | 74.6 | — | 62.9 | 72.7 | 50 | 48.6 | — | — | — | — | — | — | — | — | — | |
| A^2_LR cross-modelConfiguration=A^2_LR cross-model, Backbone=ViT-S × ViT-G2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 79.9 | — | |
| DARModel=ResNet18, Initialization=Random2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.6 | |
| DARConfig=ResNet-502026.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96.2 | |
| DARConfig=90%2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.8 | |
| DARConfig=Pretrained2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.4 | |
| DFRGroup Info=Yes2025.08 | — | — | — | — | — | — | — | 79.1 | 64.3 | 70 | 76.4 | 58.7 | 54.1 | 67.1 | — | |
| DFRConfiguration=DFR, Backbone=ViT-S (21M)2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.9 | — | |
| DFRConfiguration=DFR, Backbone=ViT-B (86M)2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 84.5 | — | |
| DFRConfiguration=DFR, Backbone=ViT-L (300M)2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.1 | — | |
| DFRConfiguration=DFR, Backbone=ViT-G (1.1B)2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.9 | — | |
| DFR + A^2Configuration=DFR + A^2, Backbone=ViT-S (21M)2026.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | 88.8 | — | |
| ERMGroup Info=No2025.08 | — | — | — | — | — | — | — | 78.4 | 63.4 | 71.1 | 72.9 | 52.7 | 50.7 | 64.9 | — | |
| ERMModel=ResNet18, Initialization=Random2026.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 89.2 | |
| GroupDROGroup Info=Yes2025.08 | — | — | — | — | — | — | — | 86.7 | 67.2 | 76.4 | 74.3 | 55.7 | 49.9 | 68.3 | — | |
| IRMGroup Info=Yes2025.08 | — | — | — | — | — | — | — | 78.4 | 64.5 | 64.9 | 77.9 | 57.1 | 50.7 | 65.6 | — | |
| SupERGroup Info=No2025.08 | — | — | — | — | — | — | — | 82.7 | 80.3 | 83.8 | 87.4 | 83.4 | 79.9 | 82.9 | — | |
| UWGroup Info=Yes2025.08 | — | — | — | — | — | — | — | 87.4 | 67.9 | 75.9 | 72.9 | 52.7 | 50.7 | 67.9 | — |