Image Classification on ImageNet 1% labeled 1.0
84.6AccuracyDHO
Evaluation results
| Method | Links | |
|---|---|---|
| DHOArchitecture=ViT-L/14, Params (M)=3042025.05 | 84.6 | |
| DFNArchitecture=ViT-H/14, Params (M)=6322025.05 | 84.4 | |
| CE + KD (logit)Architecture=ViT-L/14, Params (M)=3042025.05 | 83.1 | |
| SigLIPArchitecture=ViT-SO400M/14, Params (M)=4002025.05 | 83.1 | |
| REACTArchitecture=ViT-L/14, Params (M)=3042025.05 | 81.6 | |
| REACT (Gated-Image)Architecture=ViT-L/14, Params (M)=3802025.05 | 81.6 | |
| DHOArchitecture=ViT-B/16, Params (M)=862025.05 | 81.6 | |
| MCTArchitecture=Multi-arch (2), Params (M)=6082025.05 | 80.7 | |
| CLIPArchitecture=ViT-L/14, Params (M)=3042025.05 | 80.5 | |
| MCTArchitecture=Multi-arch (4), Params (M)=10712025.05 | 80.5 | |
| CTArchitecture=Multi-arch (2), Params (M)=6082025.05 | 80.1 | |
| Semi-ViTArchitecture=ViT-H/14, Params (M)=6322025.05 | 80 | |
| CTArchitecture=Multi-arch (4), Params (M)=10712025.05 | 80 | |
| CE + KD (logit)Architecture=ViT-B/16, Params (M)=862025.05 | 79.8 | |
| REACT (Gated-Image)Architecture=ViT-B/16, Params (M)=1292025.05 | 77.4 | |
| Semi-ViTArchitecture=ViT-L/14, Params (M)=3072025.05 | 77.3 | |
| SimCLR v2 self-distillArchitecture=ResNet-154 (3x+SK), Params (M)=7952025.05 | 76.6 | |
| REACTArchitecture=ViT-B/16, Params (M)=862025.05 | 76.1 | |
| SimCLR v2 distillArchitecture=ResNet-50 (2x+SK), Params (M)=1402025.05 | 75.9 | |
| MSNArchitecture=ViT-B/4, Params (M)=862025.05 | 75.7 | |
| CLIPArchitecture=ViT-B/16, Params (M)=862025.05 | 74.3 |