Long-tailed Visual Recognition on ImageNet LT
82.9Overall AccuracyLIFT w/ TTE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LIFT w/ TTEBackbone=ViT-L/14, Learnable Params.=0.86M, #Epochs=10, TTE=true2023.09 | 82.9 | 85.3 | 82.2 | 78.6 | — | |
| LIFTBackbone=ViT-L/14, Learnable Params.=0.86M, #Epochs=102023.09 | 82.4 | 84.8 | 81.7 | 78 | — | |
| DecoderBackbone=ViT-L/14, Learnable Params.=39.79M, #Epochs=~182023.09 | 79.3 | — | — | — | — | |
| VL-LTRBackbone=ViT-Base, CLIP weights initialized=true2021.11 | 77.2 | 84.5 | 74.6 | 59.3 | — | |
| Zero-shot CLIPBackbone=ViT-L/142023.09 | 73.6 | 74.6 | 73.1 | 72.3 | — | |
| VL-LTRBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 70.1 | 77.8 | 67 | 50.8 | — | |
| BaselineBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 60.5 | 74.4 | 56.9 | 34.5 | — | |
| PaCoBackbone=ResNeXt-1012021.11 | 60 | 68.2 | 58.7 | 41 | — | |
| Zero-Shot CLIPBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 59.8 | 60.8 | 59.3 | 58.6 | — | |
| TADEBackbone=ResNeXt-502021.11 | 58.8 | 66.5 | 57 | 43.5 | — | |
| Gaussian Mixture Likelihood lossEpochs=400, Backbone=ResNeXt-502023.05 | 58.8 | 68.2 | 56.7 | 39.5 | — | |
| Gaussian Mixture Likelihood lossEpochs=90, Backbone=ResNeXt-502023.05 | 58.3 | 68.7 | 55.7 | 38.6 | — | |
| PaCoEpochs=400, Backbone=ResNeXt-502023.05 | 58.2 | 68 | 56.4 | 37.2 | — | |
| CBDENSBackbone=ResNet-1522021.04 | 57.7 | 71.2 | 54.5 | 30.7 | — | |
| Meta-SuperDisco2023.03 | 57.1 | 66.1 | 53.3 | 37.1 | — | |
| RIDE (4 Experts)Backbone=ResNeXt-502021.11 | 56.8 | 68.2 | 53.8 | 36 | — | |
| BCLEpochs=90, Backbone=ResNeXt-502023.05 | 56.7 | 67.2 | 53.9 | 36.5 | — | |
| Park et al.Venue=CVPR 222023.03 | 56.2 | 66.4 | 53.9 | 35.6 | — | |
| Li et al.Venue=CVPR 212023.03 | 56 | 66.8 | 51.1 | 35.4 | — | |
| SSDBackbone=ResNeXt-502021.11 | 56 | 66.8 | 53.1 | 35.4 | — | |
| CBDENSBackbone=ResNet-502021.04 | 55.6 | 68.5 | 52.7 | 29.2 | — | |
| ResLTBackbone=ResNeXt-1012021.11 | 55.1 | 63.3 | 53.3 | 40.3 | — | |
| Parisot et al.Venue=CVPR 222023.03 | 54.1 | 63.2 | 52.1 | 36.9 | — | |
| Alshammari et al.Venue=CVPR 222023.03 | 53.9 | 62.5 | 50.4 | 41.5 | — | |
| CBDBackbone=ResNet-1522021.04 | 53.9 | 68.1 | 50.1 | 27.1 | — | |
| Samuel et al.Venue=ICCV 212023.03 | 53.5 | 64 | 49.8 | 33.1 | — | |
| DisAlignEpochs=90, Backbone=ResNeXt-502023.05 | 53.4 | 62.7 | 52.1 | 31.4 | — | |
| LWSBackbone=ResNeXt-1522019.10 | 53.3 | — | — | — | — | |
| LWSBackbone=ResNeXt-1522021.11 | 53.3 | 63.5 | 50.4 | 34.2 | — | |
| He et al.Venue=ICCV 212023.03 | 53.1 | 64.1 | 50.4 | 31.5 | — | |
| Zhang et al.Venue=CVPR 212023.03 | 52.9 | 61.3 | 52.2 | 31.4 | — | |
| τ-normalizedBackbone=ResNeXt-1522019.10 | 52.8 | — | — | — | — | |
| tau-normalizedBackbone=ResNeXt-1522021.11 | 52.8 | 62.2 | 50.1 | 35.8 | — | |
| cRTBackbone=ResNeXt-1522019.10 | 52.4 | — | — | — | — | |
| cRTBackbone=ResNeXt-1522021.11 | 52.4 | 64.7 | 49.1 | 29.4 | — | |
| Logit Adj.Backbone=ResNet-1522021.04 | 52.1 | — | — | — | — | |
| ELF(LDAM)Backbone=ResNet-502021.04 | 52 | 64.3 | 47.9 | 31.4 | — | |
| LADEEpochs=90, Backbone=ResNeXt-502023.05 | 51.9 | 62.3 | 49.3 | 31.2 | — | |
| CBDBackbone=ResNet-502021.04 | 51.6 | 65.2 | 48 | 25.9 | — | |
| Kang et al.Venue=ICLR 212023.03 | 51.5 | 61.8 | 49.4 | 30.9 | — | |
| LWSBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 51.5 | 62.2 | 48.6 | 31.8 | — | |
| BALMSEpochs=90, Backbone=ResNeXt-502023.05 | 51.4 | 62.2 | 48.8 | 29.8 | — | |
| NCMBackbone=ResNeXt-1522019.10 | 51.3 | — | — | — | — | |
| cRT+SSPBackbone=ResNet-502021.04 | 51.3 | — | — | — | — | |
| NCMBackbone=ResNeXt-1522021.11 | 51.3 | 60.3 | 49 | 33.6 | — | |
| tau-normalizedBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 51.2 | 60.9 | 48.4 | 33.8 | — | |
| Logit Adj.Backbone=ResNet-502021.04 | 51.1 | — | — | — | — | |
| cRTBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 50.8 | 63.3 | 47.2 | 27.8 | — | |
| LWSBackbone=ResNet-1522021.04 | 50.5 | 60.6 | 47.8 | 31.4 | — | |
| OLTRBackbone=ResNeXt-152, Source=OLTR with proposed representation learning stage2019.10 | 50.3 | — | — | — | — | |
| cRTBackbone=ResNet-1522021.04 | 50.1 | 61.8 | 46.8 | 28.4 | — | |
| smDRAGONBackbone=ResNeXt-502021.11 | 50.1 | — | — | — | — | |
| Kang et al.Venue=ICLR 192023.03 | 49.9 | 60.2 | 47.2 | 30.3 | — | |
| LWSBackbone=ResNeXt-502019.10 | 49.9 | — | — | — | — | |
| LWSEpochs=90, Backbone=ResNeXt-502023.05 | 49.9 | 60.2 | 47.2 | 30.3 | — | |
| cRTBackbone=ResNeXt-502019.10 | 49.5 | — | — | — | — | |
| τ-normalizedBackbone=ResNeXt-502019.10 | 49.4 | — | — | — | — | |
| tau-normEpochs=90, Backbone=ResNeXt-502023.05 | 49.4 | 59.1 | 46.9 | 30.7 | — | |
| GKL-KDTeacher=ResNeXt-101, Student=ResNet-502025.03 | 49.4 | 70.31 | 43.47 | 10.85 | — | |
| IKL-KDTeacher=ResNeXt-101, Student=ResNet-502025.03 | 49.29 | 70.06 | 43.47 | 10.99 | — | |
| NCMBackbone=ResNet-50, CLIP weights initialized=true2021.11 | 49.2 | 58.9 | 46.6 | 31.1 | — | |
| ELF(CE)Backbone=ResNet-502021.04 | 48.9 | 60.7 | 45.5 | 27.7 | — | |
| BaselineStudent=ResNet-1012025.03 | 48.33 | 68.91 | 42.32 | 11.24 | — | |
| KL-KDTeacher=ResNeXt-101, Student=ResNet-502025.03 | 48.31 | 68.83 | 42.31 | 11.37 | — | |
| JointBackbone=ResNeXt-1522019.10 | 47.8 | — | — | — | — | |
| LWSBackbone=ResNet-502021.04 | 47.7 | 57.1 | 45.2 | 29.3 | — | |
| NCMBackbone=ResNeXt-502019.10 | 47.3 | — | — | — | — | |
| cRTBackbone=ResNet-502021.04 | 47.3 | 58.8 | 44 | 26.1 | — | |
| OLTRBackbone=ResNeXt-50, Source=OLTR with proposed representation learning stage2019.10 | 46.3 | — | — | — | — | |
| OLTRBackbone=ResNeXt-502021.11 | 46.3 | — | — | — | — | |
| BaselineStudent=ResNet-502025.03 | 45.47 | 67.25 | 38.56 | 8.21 | — | |
| GKL-KDTeacher=ResNeXt-101, Student=ResNet-182025.03 | 45.4 | 66.72 | 38.69 | 8.69 | — | |
| IKL-KDTeacher=ResNeXt-101, Student=ResNet-182025.03 | 45.21 | 66.6 | 38.53 | 8.19 | — | |
| JointBackbone=ResNeXt-502019.10 | 44.4 | — | — | — | — | |
| Cross EntropyBackbone=ResNeXt-502021.11 | 44.4 | 65.9 | 37.5 | 7.7 | — | |
| KL-KDTeacher=ResNeXt-101, Student=ResNet-182025.03 | 44.32 | 64.6 | 37.88 | 9.53 | — | |
| Focal LossEpochs=90, Backbone=ResNeXt-502023.05 | 43.7 | 64.3 | 37.1 | 8.2 | — | |
| cRTBackbone=ResNet-102019.10 | 41.8 | — | — | — | — | |
| LWSBackbone=ResNet-102019.10 | 41.4 | — | — | — | — | |
| BaselineStudent=ResNet-182025.03 | 41.15 | 63.16 | 33.47 | 5.88 | — | |
| τ-normalizedBackbone=ResNet-102019.10 | 40.6 | — | — | — | — | |
| OLTR + CMW-NetBackbone=ResNet-102022.02 | 39.5 | 47.2 | 39.2 | 19.7 | — | |
| OLTRBackbone=ResNeXt-50, Source=Reproduced2019.10 | 37.7 | — | — | — | — | |
| OLTRBackbone=ResNet-10, Source=OLTR with proposed representation learning stage2019.10 | 37.3 | — | — | — | — | |
| OLTRBackbone=ResNet-10, Source=Reported in Liu et al. (2019)2019.10 | 35.6 | — | — | — | — | |
| OLTRBackbone=ResNet-102022.02 | 35.6 | 43.2 | 35.1 | 18.5 | — | |
| NCMBackbone=ResNet-102019.10 | 35.5 | — | — | — | — | |
| JointBackbone=ResNet-102019.10 | 34.8 | — | — | — | — | |
| OLTRBackbone=ResNet-10, Source=Reproduced2019.10 | 34.1 | — | — | — | — | |
| Lifted LossBackbone=ResNet-102019.10 | 30.8 | — | — | — | — | |
| Lifted LossBackbone=ResNet-102022.02 | 30.8 | 35.8 | 30.4 | 17.9 | — | |
| Range LossBackbone=ResNet-102019.10 | 30.7 | — | — | — | — | |
| Range LossBackbone=ResNet-102022.02 | 30.7 | 35.8 | 30.3 | 17.6 | — | |
| Focal LossBackbone=ResNet-102019.10 | 30.5 | — | — | — | — | |
| Focal lossBackbone=ResNet-102022.02 | 30.5 | 36.4 | 29.9 | 16 | — | |
| FSLwFBackbone=ResNet-102019.10 | 28.4 | — | — | — | — | |
| OLTRBackbone=ResNeXt-152, Source=Reproduced2019.10 | 24.8 | — | — | — | — | |
| ERMBackbone=ResNet-102022.02 | 20.9 | 40.9 | 10.7 | 0.4 | — |