Image Classification on MetaShift
93Average AccuracyCBDebug
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CBDebugModel type=Post-hoc CBM, Feedback=Automated2025.09 | 93 | 87.5 | |
| OriginalModel type=Post-hoc CBM, Feedback=Automated2025.09 | 92.9 | 84.5 | |
| RetrainModel type=Post-hoc CBM, Feedback=Automated2025.09 | 92.4 | 83 | |
| Reweight OnlyModel type=Post-hoc CBM, Feedback=Automated, Component=Label and Reweight step2025.09 | 92 | 84.1 | |
| Augment OnlyModel type=Post-hoc CBM, Feedback=Automated, Component=Augment step2025.09 | 92 | 84.4 | |
| SCERBackbone=ResNet-502025.11 | 91.6 | 86.7 | |
| ERMBackbone=ResNet-502025.11 | 91.3 | 82.6 | |
| ReSampleBackbone=ResNet-502025.11 | 91.2 | 85.6 | |
| GroupDROBackbone=ResNet-502025.11 | 91 | 85.6 | |
| RemoveModel type=Post-hoc CBM, Feedback=Automated2025.09 | 90.5 | 79.6 | |
| LISABackbone=ResNet-502025.11 | 89.5 | 84.1 | |
| TCSL-CSGroup Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 89.29 | 79.4 | |
| DinoV2 + AIMArch.=ViT-B, Backbone State=Frozen2025.06 | 88.9 | 83 | |
| iFAMArch.=ViT-B, K=42025.06 | 88.7 | 88.6 | |
| RGbalGroup Info Train=true, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 88.31 | 75.23 | |
| EL2N (Top)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 87.79 | 74.07 | |
| D2 (EL2N+ResNet)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 87.73 | 73.61 | |
| PDEBackbone=ResNet-502025.11 | 87.4 | 78.1 | |
| SelfSup (Top)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.75 | 75.46 | |
| D2 (SelfSup+ResNet)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.63 | 75.46 | |
| SelfSup (Hist)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.52 | 71.99 | |
| D2 (SelfSup+CLIP)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.28 | 72.69 | |
| EL2N (Hist)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.11 | 72.22 | |
| SelfSup (Bot)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.11 | 67.59 | |
| RandomGroup Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 86.05 | 71.53 | |
| ElRepBackbone=ResNet-502025.11 | 85.9 | 72.1 | |
| D2 (EL2N+CLIP)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 85.76 | 72.22 | |
| DinoV2 (Fine-tuned)Arch.=ViT-B, Backbone State=Fine-tuned2025.06 | 84.7 | 76.8 | |
| Early mask FOUNDArch.=ViT-B, K=12025.06 | 84.5 | 77.1 | |
| DinoV2 (Frozen)Arch.=ViT-B, Backbone State=Frozen2025.06 | 83.2 | 72.6 | |
| PDiscoFormerArch.=ViT-B, K=42025.06 | 83.2 | 75.5 | |
| Late mask FOUNDArch.=ViT-B, K=12025.06 | 82.3 | 73.5 | |
| DDBGroup Info (train/val)=✗/✓2026.03 | 81.3 | 81.2 | |
| DinoV2 + EPArch.=ViT-B, Backbone State=Frozen2025.06 | 80.4 | 70.3 | |
| EL2N (Bot)Group Info Train=false, Coreset fraction (r)=0.6, Retraining Method=CB ERM2026.06 | 80.21 | 60.65 | |
| DaCGroup Info (train/val)=✗/✓2026.03 | 79.3 | 78.3 | |
| DFRGroup Info (train/val)=✗/✓✓2026.03 | 77.5 | 72.8 | |
| HSFMGroup Info (train/val)=✗/✓2026.03 | 77.4 | 77.2 | |
| ERMArch.=ViT-B2025.06 | 75.8 | 62.5 | |
| Base (ERM)Group Info (train/val)=✗/✗2026.03 | 75.65 | 64.1 | |
| DISCArch.=R-502025.06 | 75.5 | 73.5 | |
| JTTGroup Info (train/val)=✗/✓2026.03 | 74.4 | 64.6 | |
| Group DROGroup Info (train/val)=✓/✓2026.03 | 73.6 | 66 | |
| GroupDROArch.=R-502025.06 | 73.6 | 66 | |
| ERMArch.=R-502025.06 | 72.9 | 62.1 | |
| LISAGroup Info (train/val)=✓/✓2026.03 | 70 | 59.8 |