Image Classification on MetaShift (test)
92.1Average AccuracyCVaRDRO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CVaRDRO2025.11 | 92.1 | 84.6 | — | — | — | — | |
| IRM2025.11 | 91.8 | 83 | — | — | — | — | |
| ReWeight2025.11 | 91.7 | 85.6 | — | — | — | — | |
| CBLoss2025.11 | 91.7 | 85.5 | — | — | — | — | |
| Focal2025.11 | 91.7 | 81.5 | — | — | — | — | |
| Mixup2025.11 | 91.6 | 81 | — | — | — | — | |
| BSoftmax2025.11 | 91.6 | 83.1 | — | — | — | — | |
| SCER2025.11 | 91.6 | 86.7 | — | — | — | — | |
| SqrtReWeight2025.11 | 91.5 | 84.6 | — | — | — | — | |
| LDAM2025.11 | 91.5 | 83.6 | — | — | — | — | |
| ERM2025.11 | 91.3 | 82.6 | — | — | — | — | |
| JTT2025.11 | 91.2 | 83.6 | — | — | — | — | |
| ReSample2025.11 | 91.2 | 85.6 | — | — | — | — | |
| GroupDRO2025.11 | 91 | 85.6 | — | — | — | — | |
| LISA2025.11 | 89.5 | 84.1 | — | — | — | — | |
| MMD2025.11 | 89.4 | 85.9 | — | — | — | — | |
| TCSL-CSGroup Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 89 | 74.54 | — | — | — | — | |
| TCSL-CSGroup Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 88.6 | 76.85 | — | — | — | — | |
| DFR2025.11 | 88.4 | 85.4 | — | — | — | — | |
| D2 (EL2N+ResNet)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 87.91 | 79.17 | — | — | — | — | |
| RGbalGroup Info Train=true, Coreset Selection Ratio (r)=0.22026.06 | 87.85 | 80.79 | — | — | — | — | |
| RGbalGroup Info Train=✓, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 87.62 | 72.45 | — | — | — | — | |
| EL2N (Top)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 87.5 | 77.55 | — | — | — | — | |
| PDE2025.11 | 87.4 | 78.1 | — | — | — | — | |
| D2 (SelfSup+ResNet)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 87.38 | 74.77 | — | — | — | — | |
| EL2N (Top)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 87.27 | 72.92 | — | — | — | — | |
| SelfSup (Top)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 87.27 | 74.31 | — | — | — | — | |
| D2 (EL2N+ResNet)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 87.21 | 72.92 | — | — | — | — | |
| RandomGroup Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 86.92 | 72.45 | — | — | — | — | |
| D2 (EL2N+CLIP)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 86.86 | 73.84 | — | — | — | — | |
| EL2N (Hist)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 86.86 | 73.15 | — | — | — | — | |
| SelfSup (Hist)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 86.75 | 71.99 | — | — | — | — | |
| SelfSup (Bot)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 86.69 | 70.37 | — | — | — | — | |
| ElRep2025.11 | 85.9 | 72.1 | — | — | — | — | |
| D2 (SelfSup+CLIP)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 85.36 | 70.6 | — | — | — | — | |
| D2 (EL2N+CLIP)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 85.07 | 68.98 | — | — | — | — | |
| EL2N (Hist)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 84.14 | 68.98 | — | — | — | — | |
| SelfSup (Hist)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 83.97 | 67.59 | — | — | — | — | |
| D2 (SelfSup+CLIP)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 83.97 | 68.29 | — | — | — | — | |
| RandomGroup Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 83.97 | 67.36 | — | — | — | — | |
| GRSSLgroup_info_train=used, group_info_val=used2026.07 | 82.6 | 81.7 | — | — | — | — | |
| EL2N (Bot)Group Info Train=x, r (keep ratio)=0.8, Retraining Protocol=CB ERM2026.06 | 82.06 | 65.97 | — | — | — | — | |
| SelfSup (Bot)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 81.02 | 47.92 | — | — | — | — | |
| LfF2025.11 | 80.2 | 73.1 | — | — | — | — | |
| DaCgroup_info_train=not used, group_info_val=used2026.07 | 79.6 | 78.3 | — | — | — | — | |
| SupERGroup Info?=false, Train Twice?=false2025.08 | 79.5 | — | 81.7 | 80.5 | 79.2 | 76.6 | |
| DDBgroup_info_train=not used, group_info_val=used2026.07 | 79.3 | 78.2 | — | — | — | — | |
| D2 (SelfSup+ResNet)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 78.99 | 48.84 | — | — | — | — | |
| SelfSup (Top)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 78.88 | 48.38 | — | — | — | — | |
| EL2N (Bot)Group Info Train=false, Coreset Selection Ratio (r)=0.22026.06 | 77.95 | 52.78 | — | — | — | — | |
| DFRgroup_info_train=not used, group_info_val=used2026.07 | 77.5 | 72.8 | — | — | — | — | |
| GALSGroup Info?=false, Train Twice?=false2025.08 | 76.3 | — | 80.5 | 77.4 | 78.3 | 69.1 | |
| CVaR DROGroup Info?=false, Train Twice?=false2025.08 | 75.8 | — | 80.7 | 78.2 | 74.6 | 69.8 | |
| ERMGroup Info?=false, Train Twice?=false2025.08 | 75.3 | — | 80.5 | 78 | 73.6 | 69.2 | |
| LfFGroup Info?=false, Train Twice?=false2025.08 | 75.1 | — | 79.2 | 77.2 | 74.8 | 69.1 | |
| CnCGroup Info?=false, Train Twice?=true2025.08 | 75.1 | — | 82.1 | 77 | 74.4 | 66.7 | |
| JTTGroup Info?=false, Train Twice?=true2025.08 | 74.9 | — | 80.8 | 76.4 | 73.2 | 69.3 | |
| ERMgroup_info_train=not used, group_info_val=not used2026.07 | 73.9 | 61.3 | — | — | — | — | |
| Group DROgroup_info_train=used, group_info_val=used2026.07 | 72.9 | 67.1 | — | — | — | — | |
| LISAgroup_info_train=used, group_info_val=used2026.07 | 70 | 59.8 | — | — | — | — |