Image Classification on CIFAR-100 Long-Tailed (test)
83.6Top-1 AccuracyLoFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LoFTbackbone=OpenCLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 83.6 | — | |
| LoFTbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 83.2 | — | |
| LoFTbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 82.3 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 82.1 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 82 | — | |
| LoFTbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 81.8 | — | |
| PEFTbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 81.7 | — | |
| PEFTbackbone=OpenCLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 81.7 | — | |
| PEFTbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 81.7 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 81.6 | — | |
| LoFTbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 81.2 | — | |
| LoFTbackbone=CLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 81.1 | — | |
| PEFTbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 81.1 | — | |
| LoFTbackbone=CLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 81 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 80.8 | — | |
| LoFTbackbone=CLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 80.6 | — | |
| LoFTbackbone=OpenCLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 80.3 | — | |
| LoFT-OWbackbone=CLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 80 | — | |
| LoFT-OWbackbone=CLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 80 | — | |
| LoFT-OWbackbone=CLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 79.9 | — | |
| LoFTbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 79.8 | — | |
| PEFTbackbone=CLIP, gamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 79.7 | — | |
| PEFTbackbone=CLIP, gamma_u=1 (uniform), N1=150, M1=3002025.09 | 79.7 | — | |
| PEFTbackbone=CLIP, gamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 79.7 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 79.7 | — | |
| LoFTbackbone=CLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 79.3 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 79.3 | — | |
| LoFTbackbone=CLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 78.8 | — | |
| LoFT-OWbackbone=CLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 78.6 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 78.6 | — | |
| PEFTbackbone=CLIP, gamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 78.4 | — | |
| LoFTbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 78.4 | — | |
| LoFTbackbone=CLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 78 | — | |
| PEFTbackbone=OpenCLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 78 | — | |
| PEFTbackbone=OpenCLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 78 | — | |
| PEFTbackbone=OpenCLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 78 | — | |
| LoFTbackbone=CLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 77.3 | — | |
| LoFT-OWbackbone=CLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 76.6 | — | |
| LoFT-OWbackbone=CLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 76.5 | — | |
| LoFT-OWbackbone=CLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 76.4 | — | |
| PEFTbackbone=CLIP, gamma_l=10, gamma_u=10, N1=50, M1=4002025.09 | 75.5 | — | |
| PEFTbackbone=CLIP, gamma_u=1 (uniform), N1=50, M1=4002025.09 | 75.5 | — | |
| PEFTbackbone=CLIP, gamma_u=1/10 (reversed), N1=50, MC=4002025.09 | 75.5 | — | |
| LoFT-OWbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 75.4 | — | |
| LoFTbackbone=CLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 75.3 | — | |
| PEFTbackbone=OpenCLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 75.3 | — | |
| PEFTbackbone=CLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 74 | — | |
| LoFT-OWbackbone=CLIP, gamma_l=20, gamma_u=20, N1=50, M1=4002025.09 | 73.6 | — | |
| FixMatch+ACRgamma_u=1 (uniform), N1=150, M1=3002025.09 | 73.4 | — | |
| FixMatch+CCLgamma_u=1 (uniform), N1=150, M1=3002025.09 | 67.9 | — | |
| FixMatch+ACRgamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 67.6 | — | |
| FixMatch+ACR+BEMgamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 66.3 | — | |
| FixMatch+ACRgamma_u=1 (uniform), N1=50, M1=4002025.09 | 66 | — | |
| FixMatch+ACRgamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 65.6 | — | |
| FixMatch+CCLgamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 64.7 | — | |
| FixMatch+CCLgamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 63.5 | — | |
| LWSImbalance Factor=10, Training Strategy=Decoupled training2020.07 | 63.4 | — | |
| cRTImbalance Factor=10, Training Strategy=Decoupled training2020.07 | 63.3 | — | |
| FixMatch+TCBCgamma_u=1 (uniform), N1=150, M1=3002025.09 | 63.2 | — | |
| Hybrid-SCBackbone=ResNet-32, Imbalance ratio=102021.03 | 63.05 | — | |
| BALMSImbalance Factor=102020.07 | 63 | — | |
| BALMSImbalance Factor=10, Training Strategy=Decoupled training2020.07 | 63 | — | |
| SMCBackbone=ResNet-322022.11 | 62.5 | — | |
| Hybrid-PSCBackbone=ResNet-32, Imbalance ratio=102021.03 | 62.37 | — | |
| CMOBackbone=ResNet-322022.11 | 62.3 | — | |
| LDAM LossImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 62.1 | — | |
| SoftmaxImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 61.9 | — | |
| CBWImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 61.4 | — | |
| CBSImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 61.2 | — | |
| FixMatch+CPEgamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 60.8 | — | |
| MBJImbalanced ratio (IR)=102020.08 | 60.7 | — | |
| Equalization LossImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 60.5 | — | |
| Focal LossImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 60 | — | |
| FixMatch+TCBCgamma_u=1/10 (reversed), N1=150, MC=3002025.09 | 59.9 | — | |
| Class Balanced LossImbalance Factor=10, Training Strategy=End-to-end training2020.07 | 59.8 | — | |
| MBJ + RIDE (4 experts)Imbalanced ratio (IR)=502020.08 | 59.8 | — | |
| FixMatch+ACR+BEMgamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 59.8 | — | |
| FixMatch+CPEgamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 59.8 | — | |
| FixMatch+CCLgamma_u=1 (uniform), N1=50, M1=4002025.09 | 59.8 | — | |
| De-confound-TDEImbalance ratio=10, Backbone=ResNet-32, Training scheduler=BBN warm-up2020.09 | 59.6 | — | |
| Casual modelBackbone=ResNet-32, Imbalance ratio=102021.03 | 59.6 | — | |
| De-confound-TDEImbalanced ratio (IR)=102020.08 | 59.6 | — | |
| FixMatch+TCBCgamma_l=10, gamma_u=10, N1=150, M1=3002025.09 | 59.4 | — | |
| RemixBackbone=ResNet-322022.11 | 59.2 | — | |
| BBNBackbone=ResNet-32, Imbalance ratio=102021.03 | 59.12 | — | |
| BBNImbalance ratio=10, Backbone=ResNet-32, Training scheduler=BBN warm-up2020.09 | 59.1 | — | |
| BBNImbalanced ratio (IR)=102020.08 | 59.1 | — | |
| RIDE (4 experts)Imbalanced ratio (IR)=502020.08 | 59 | — | |
| TSCBackbone=ResNet-322022.11 | 59 | — | |
| De-confoundImbalance ratio=10, Backbone=ResNet-32, Training scheduler=BBN warm-up2020.09 | 58.9 | — | |
| SSPImbalanced ratio (IR)=102020.08 | 58.9 | — | |
| MBJ + RIDE (4 experts)Imbalanced ratio (IR)=102020.08 | 58.9 | — | |
| FixMatch+ACRgamma_l=20, gamma_u=20, N1=150, M1=3002025.09 | 58.9 | — | |
| LDAM-DRWImbalance Factor=102020.07 | 58.71 | — | |
| LDAM-DRWBackbone=ResNet-32, Imbalance ratio=102021.03 | 58.71 | — | |
| LDAMImbalance ratio=10, Backbone=ResNet-32, Training scheduler=BBN warm-up2020.09 | 58.7 | — | |
| LDAM-DRWImbalanced ratio (IR)=102020.08 | 58.7 | — | |
| LDAM-DRWBackbone=ResNet-322022.11 | 58.7 | — | |
| Meta-Weight-NetImbalance Factor=102020.07 | 58.46 | — | |
| RIDE (4 experts)Imbalanced ratio (IR)=102020.08 | 58.4 | — |