Image Classification on NICO (test)
85.16Top-1 AccNAS-OOD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| NAS-OODAnimal Params (M)=3.25, Vehicle Params (M)=3, Average Params (M)=3.132021.09 | 85.16 | — | 88.72 | 81.59 | |
| DecAugBackbone=ResNet-18, Params (M)=11.72021.09 | 82.67 | — | 85.23 | 80.12 | |
| JiGenBackbone=ResNet-18, Params (M)=11.72021.09 | 82.2 | — | 84.95 | 79.45 | |
| MoCo-v2+IP-IRMEvaluation Protocol=Linear classifier, Feature Representation=SSL with IP-IRM2021.10 | 79.5 | — | — | — | |
| MixupBackbone=ResNet-18, Params (M)=11.7, Implemented by authors=true2021.09 | 78.63 | — | 80.27 | 77 | |
| MoCo-v2Evaluation Protocol=Linear classifier, Feature Representation=SSL, Reproduced=true2021.10 | 78 | — | — | — | |
| CNBBBackbone=ResNet-18, Params (M)=11.72021.09 | 77.77 | — | 78.16 | 77.39 | |
| MTLBackbone=ResNet-18, Params (M)=11.7, Implemented by authors=true2021.09 | 77 | — | 78.89 | 75.11 | |
| DROBackbone=ResNet-18, Params (M)=11.7, Implemented by authors=true2021.09 | 76.1 | — | 77.61 | 74.59 | |
| CORALBackbone=ResNet-18, Params (M)=11.7, Implemented by authors=true2021.09 | 75.95 | — | 80.27 | 71.64 | |
| CumixBackbone=ResNet-18, Params (M)=11.72021.09 | 75.76 | — | 76.78 | 74.74 | |
| ERMBackbone=ResNet-18, Params (M)=11.72021.09 | 75.19 | — | 75.87 | 74.52 | |
| DANNBackbone=ResNet-18, Params (M)=11.72021.09 | 73.91 | — | 75.59 | 72.23 | |
| PCLEvaluation Protocol=Linear classifier, Feature Representation=SSL2021.10 | 72.6 | — | — | — | |
| SimSiam+IP-IRMEvaluation Protocol=Linear classifier, Feature Representation=SSL with IP-IRM2021.10 | 70.9 | — | — | — | |
| REXBackbone=ResNet-18, Params (M)=11.72021.09 | 70.25 | — | 74.31 | 66.2 | |
| MMDBackbone=ResNet-18, Params (M)=11.7, Implemented by authors=true2021.09 | 69.47 | — | 70.91 | 68.04 | |
| MoCo-v1Evaluation Protocol=Linear classifier, Feature Representation=SSL2021.10 | 69.3 | — | — | — | |
| PIRLEvaluation Protocol=Linear classifier, Feature Representation=SSL2021.10 | 69.1 | — | — | — | |
| SimSiamEvaluation Protocol=Linear classifier, Feature Representation=SSL, Reproduced=true2021.10 | 66.7 | — | — | — | |
| SimCLR+IP-IRMEvaluation Protocol=Linear classifier, Feature Representation=SSL with IP-IRM2021.10 | 66.7 | — | — | — | |
| InsDisEvaluation Protocol=Linear classifier, Feature Representation=SSL2021.10 | 65.6 | — | — | — | |
| SimCLREvaluation Protocol=Linear classifier, Feature Representation=SSL, Reproduced=true2021.10 | 64.5 | — | — | — | |
| IRMBackbone=ResNet-18, Params (M)=11.72021.09 | 60.58 | — | 59.17 | 62 | |
| LWBCSpurious attribute label=false2022.06 | 52.84 | — | — | — | |
| SSL+ERMSpurious attribute label=false2022.06 | 52.24 | — | — | — | |
| CaaMSpurious attribute label=false2022.06 | 46.62 | — | — | — | |
| ReBiasSpurious attribute label=false2022.06 | 45.23 | — | — | — | |
| RUBiSpurious attribute label=true2022.06 | 44.37 | — | — | — | |
| CutoutSpurious attribute label=true2022.06 | 43.77 | — | — | — | |
| UnshuffleSpurious attribute label=true2022.06 | 43 | — | — | — | |
| ERMSpurious attribute label=false2022.06 | 42.61 | — | — | — | |
| CBAMSpurious attribute label=false2022.06 | 42.46 | — | — | — | |
| IRMSpurious attribute label=true2022.06 | 41.46 | — | — | — | |
| RExSpurious attribute label=true2022.06 | 41.15 | — | — | — | |
| LfFSpurious attribute label=false2022.06 | 40.18 | — | — | — | |
| BCSIbaseline=ERM2024.11 | — | 43.54 | — | — | |
| BCSIbaseline=LfF2024.11 | — | 40.18 | — | — | |
| BCSIbaseline=DFA2024.11 | — | 45.69 | — | — | |
| BCSIbaseline=SelecMix2024.11 | — | 44.33 | — | — | |
| DFA2024.11 | — | 44.59 | — | — | |
| ERM2024.11 | — | 39.56 | — | — | |
| LfF2024.11 | — | 34.56 | — | — | |
| SelecMix2024.11 | — | 33.87 | — | — |