Image Classification on ImageNet Real linear probe 1.0
89.4Top-1 AccuracyTinyVit-21M
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=38, # Inference Params (M)=212024.11 | 89.4 | 98.4 | |
| CLIP-VIT-L/14Backbone=ViT-L/14, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=321, # Inference Params (M)=3212024.11 | 88.9 | — | |
| TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=23, # Inference Params (M)=112024.11 | 88.9 | 98.3 | |
| TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=21, # Inference Params (M)=212024.11 | 88.9 | 98.3 | |
| TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=17, # Inference Params (M)=112024.11 | 88.4 | 97.9 | |
| TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=29, # Inference Params (M)=212024.11 | 88.3 | 97.8 | |
| TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=11, # Inference Params (M)=112024.11 | 87.8 | 98 | |
| TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=9.9, # Inference Params (M)=5.42024.11 | 87.4 | 98.1 | |
| TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=7.6, # Inference Params (M)=5.42024.11 | 86.3 | 97.3 | |
| TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=5.4, # Inference Params (M)=5.42024.11 | 86.1 | 97.5 |