Image Classification on ImageNet-1K V1
90.88Top-1 AccCoAtNet-7
Evaluation Results
| Method | Links | |
|---|---|---|
| CoAtNet-7param=2.44B, pre-train images=JFT-3B, pre-train im size=224x224, pre-train time=20.1k, fine-tune im size=512x5122021.11 | 90.88 | |
| ViT-Gparam=1.8B, pre-train images=JFT-3B, pre-train length (#im)=164B, pre-train im size=224x224, pre-train time=>30k, fine-tune im size=518x5182021.11 | 90.45 | |
| V-MoEparam=14.7B*, pre-train images=JFT-3B, pre-train im size=224x224, pre-train time=16.8k, fine-tune im size=518x5182021.11 | 90.35 | |
| SwinV2-Gparam=3.0B, pre-train images=IN-22K-ext-70M, pre-train length (#im)=3.5B, pre-train im size=192x192, pre-train time=<0.5k†, fine-tune im size=640x6402021.11 | 90.17 | |
| SwinV2-Lparam=197M, pre-train images=IN-22K-14M, pre-train length (#im)=1.3B, pre-train im size=192x192, pre-train time=<20†, fine-tune im size=384x3842021.11 | 87.7 | |
| SwinV1-Lparam=197M, pre-train images=IN-22K-14M, pre-train length (#im)=1.3B, pre-train im size=224x224, pre-train time=<10†, fine-tune im size=384x3842021.11 | 87.3 | |
| SwinV2-Bparam=88M, pre-train images=IN-22K-14M, pre-train length (#im)=1.3B, pre-train im size=192x192, pre-train time=<30†, fine-tune im size=384x3842021.11 | 87.1 | |
| SwinV1-Bparam=88M, pre-train images=IN-22K-14M, pre-train length (#im)=1.3B, pre-train im size=224x224, pre-train time=<30†, fine-tune im size=384x3842021.11 | 86.4 | |
| FFRep. Size=2048, Fine-tuning=false2022.05 | 77.1 | |
| MRLRep. Size=2048, Fine-tuning=false2022.05 | 76.95 | |
| MRLRep. Size=1024, Fine-tuning=false2022.05 | 76.93 | |
| MRLRep. Size=512, Fine-tuning=false2022.05 | 76.82 | |
| FFRep. Size=1024, Fine-tuning=false2022.05 | 76.74 | |
| MRLRep. Size=256, Fine-tuning=false2022.05 | 76.66 | |
| MRL-ERep. Size=2048, Fine-tuning=false2022.05 | 76.65 | |
| MRL-ERep. Size=1024, Fine-tuning=false2022.05 | 76.6 | |
| MRL-ERep. Size=512, Fine-tuning=false2022.05 | 76.48 | |
| MRLRep. Size=128, Fine-tuning=false2022.05 | 76.46 | |
| MRL-ERep. Size=256, Fine-tuning=false2022.05 | 76.31 | |
| FFRep. Size=512, Fine-tuning=false2022.05 | 76.3 | |
| MRLRep. Size=64, Fine-tuning=false2022.05 | 76.17 | |
| MRL-ERep. Size=128, Fine-tuning=false2022.05 | 76.05 | |
| FFRep. Size=256, Fine-tuning=false2022.05 | 75.78 | |
| MRL-ERep. Size=64, Fine-tuning=false2022.05 | 75.48 | |
| FFRep. Size=128, Fine-tuning=false2022.05 | 75.47 | |
| FFRep. Size=64, Fine-tuning=false2022.05 | 75.45 | |
| MRLRep. Size=32, Fine-tuning=false2022.05 | 75.26 | |
| MRL-ERep. Size=32, Fine-tuning=false2022.05 | 74.8 | |
| FFRep. Size=32, Fine-tuning=false2022.05 | 74.68 | |
| MRLRep. Size=16, Fine-tuning=false2022.05 | 73.8 | |
| FFRep. Size=16, Fine-tuning=false2022.05 | 73.1 | |
| MRL-ERep. Size=16, Fine-tuning=false2022.05 | 72.38 | |
| MRLRep. Size=8, Fine-tuning=false2022.05 | 67.46 | |
| FFRep. Size=8, Fine-tuning=false2022.05 | 65.86 | |
| MRL-ERep. Size=8, Fine-tuning=false2022.05 | 56.92 |