Image Classification on ImageNet-GLT CBL 1k (test)
69.35Accuracy (Manyc)RandAug + IFL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RandAug + IFLBackbone=ResNext-50, Category=Augment2022.07 | 69.35 | 49.42 | 48.05 | 63.19 | 26.92 | 66.04 | 53.4 | 58.11 | |
| Mixup + IFLBackbone=ResNext-50, Category=Augment2022.07 | 67.71 | 47.77 | 45.87 | 62.58 | 24.71 | 67.77 | 51.43 | 57.44 | |
| RIDE + IFLMethod Category=Ensemble, Evaluation Protocol=ALT Protocol2022.07 | 67.54 | 67.13 | 51.92 | 51.72 | 37.84 | 38.46 | 52.44 | 53.17 | |
| RandAug + IFLMethod Category=Augment, Evaluation Protocol=ALT Protocol2022.07 | 67.39 | 66.81 | 51.55 | 51.28 | 37.47 | 37.97 | 52.14 | 52.74 | |
| Mixup + IFLMethod Category=Augment, Evaluation Protocol=ALT Protocol2022.07 | 65.9 | 65.88 | 49.43 | 49.43 | 35.4 | 35.89 | 50.24 | 51.04 | |
| RIDE + IFLBackbone=ResNext-50, Category=Ensemble2022.07 | 65.68 | 54.13 | 50.82 | 56.22 | 31.91 | 52.1 | 53.93 | 54.76 | |
| RandAugBackbone=ResNext-50, Category=Augment2022.07 | 64.96 | 42.63 | 40.3 | 59.1 | 15.2 | 56.6 | 46.4 | 52.13 | |
| RIDEBackbone=ResNext-50, Category=Ensemble2022.07 | 64.04 | 51.91 | 48.66 | 53.21 | 30.44 | 46.25 | 52.08 | 51.65 | |
| TADE + IFLMethod Category=Ensemble, Evaluation Protocol=ALT Protocol2022.07 | 63.5 | 62.67 | 48.03 | 47.32 | 34.69 | 34.52 | 48.74 | 48.78 | |
| RIDEMethod Category=Ensemble, Evaluation Protocol=ALT Protocol2022.07 | 63.48 | 61.42 | 45.62 | 44.16 | 32.59 | 32.26 | 47.24 | 46.67 | |
| Baseline + IFLBackbone=ResNext-50, Category=Re-balance2022.07 | 62.71 | 42.98 | 40.1 | 56.83 | 18.92 | 61.92 | 45.97 | 52.06 | |
| TADEMethod Category=Ensemble, Evaluation Protocol=ALT Protocol2022.07 | 62.63 | 61.91 | 45.84 | 45.21 | 32.82 | 32.82 | 47.1 | 47.32 | |
| RandAugMethod Category=Augment, Evaluation Protocol=ALT Protocol2022.07 | 62.35 | 61.25 | 45.04 | 44.27 | 31.47 | 31.26 | 46.29 | 46.32 | |
| TADE + IFLBackbone=ResNext-50, Category=Ensemble2022.07 | 61.71 | 55.59 | 48.87 | 53.42 | 34.02 | 40.93 | 51.78 | 52.41 | |
| Deconfound-TDEBackbone=ResNext-50, Category=Re-balance2022.07 | 61.64 | 42.74 | 43.8 | 54.44 | 13.94 | 55.12 | 46.46 | 49.86 | |
| LWS + IFLBackbone=ResNext-50, Category=Re-balance2022.07 | 61.5 | 45.43 | 43.79 | 52.85 | 23.86 | 55.58 | 47.89 | 50.29 | |
| Baseline IFLMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 61.38 | 60.78 | 44.79 | 44.21 | 31.49 | 31.98 | 45.89 | 46.42 | |
| CRT + IFLBackbone=ResNext-50, Category=Re-balance2022.07 | 61.27 | 45.84 | 43.96 | 51.67 | 24.32 | 53.64 | 47.94 | 49.63 | |
| LWS + IFLMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 61.19 | 60.45 | 44.66 | 44.07 | 31.43 | 31.91 | 45.76 | 46.25 | |
| CRT + IFLMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 61.12 | 60.25 | 44.26 | 43.65 | 31.02 | 31.31 | 45.47 | 45.81 | |
| BBNMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 60.9 | 60.17 | 41.08 | 40.81 | 27.79 | 28.26 | 43.26 | 43.86 | |
| BLSoftmax + IFLMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 60.19 | 59.46 | 43.54 | 43.14 | 30.85 | 31.46 | 44.86 | 45.43 | |
| MixupBackbone=ResNext-50, Category=Augment2022.07 | 59.68 | 37.96 | 30.83 | 55.74 | 7.09 | 34.33 | 38.81 | 45.41 | |
| BaselineBackbone=ResNext-50, Category=Re-balance2022.07 | 59.34 | 39.08 | 36.95 | 52.87 | 14.39 | 56.65 | 42.52 | 47.92 | |
| LDAMBackbone=ResNext-50, Category=Re-balance2022.07 | 59.05 | 45.39 | 43.23 | 48.8 | 24.44 | 44.99 | 46.74 | 46.86 | |
| LDAMMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 59.04 | 56.51 | 40.96 | 39.21 | 27.96 | 27.22 | 42.66 | 41.8 | |
| MixupMethod Category=Augment, Evaluation Protocol=ALT Protocol2022.07 | 58.71 | 58.04 | 40.09 | 38.99 | 27.52 | 27.54 | 42.11 | 42.42 | |
| TADEBackbone=ResNext-50, Category=Ensemble2022.07 | 58.44 | 56.38 | 48.01 | 51.41 | 36.6 | 41.08 | 50.47 | 51.85 | |
| BLSoftmax + IFLBackbone=ResNext-50, Category=Re-balance2022.07 | 58 | 53.7 | 44.7 | 51.73 | 33.49 | 37.58 | 48.34 | 50.39 | |
| CRTMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 57.45 | 56.28 | 39.72 | 38.65 | 27.58 | 27.35 | 41.59 | 41.43 | |
| Deconfound-TDEMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 57.1 | 56.58 | 39.8 | 40.08 | 27.29 | 27.96 | 41.4 | 42.36 | |
| Logit-Adj + IFLBackbone=ResNext-50, Category=Re-balance2022.07 | 56.96 | 56.22 | 46.54 | 50.1 | 36.88 | 33.29 | 49.26 | 50.02 | |
| BaselineMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 56.95 | 55.83 | 40.11 | 39.17 | 28.12 | 28.16 | 41.73 | 41.74 | |
| LWSMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 56.95 | 55.85 | 40.11 | 39.3 | 28.03 | 27.98 | 41.7 | 41.71 | |
| CRTBackbone=ResNext-50, Category=Re-balance2022.07 | 56.55 | 45.79 | 42.89 | 46.23 | 26.67 | 41.47 | 45.92 | 45.34 | |
| BLSoftmaxMethod Category=Re-balance, Evaluation Protocol=ALT Protocol2022.07 | 56.48 | 55.56 | 39.81 | 38.96 | 27.64 | 27.6 | 41.32 | 41.37 | |
| Logit-AdjBackbone=ResNext-50, Category=Re-balance2022.07 | 55.6 | 48.19 | 42.74 | 47.27 | 28.79 | 38.14 | 45.79 | 46.27 | |
| LWSBackbone=ResNext-50, Category=Re-balance2022.07 | 55.38 | 46.67 | 43.91 | 46.87 | 30.11 | 40.92 | 46.43 | 45.9 | |
| BLSoftmaxBackbone=ResNext-50, Category=Re-balance2022.07 | 54.94 | 49.27 | 43.18 | 43.91 | 28.64 | 33.4 | 45.7 | 44.48 | |
| BBNBackbone=ResNext-50, Category=Re-balance2022.07 | 54.55 | 49.7 | 44.4 | 45.05 | 31.53 | 36.04 | 46.53 | 45.56 |