List your company
ResearchFormerly WizWand

Image Classification on ImageNet Real linear probe 1.0

89.4Top-1 AccuracyTinyVit-21M
85.96886.85987.7588.641Nov 10, 2024
Updated 8mo ago

Evaluation results

MethodLinks
TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=38, # Inference Params (M)=212024.1189.498.4
CLIP-VIT-L/14Backbone=ViT-L/14, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=321, # Inference Params (M)=3212024.1188.9—
TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=23, # Inference Params (M)=112024.1188.998.3
TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=21, # Inference Params (M)=212024.1188.998.3
TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=17, # Inference Params (M)=112024.1188.497.9
TinyVit-21MBackbone=TinyVit-21M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=29, # Inference Params (M)=212024.1188.397.8
TinyVit-11MBackbone=TinyVit-11M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=11, # Inference Params (M)=112024.1187.898
TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=OPDF, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=9.9, # Inference Params (M)=5.42024.1187.498.1
TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=SVD, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=7.6, # Inference Params (M)=5.42024.1186.397.3
TinyVit-5MBackbone=TinyVit-5M, Over-parameterization method=None, Pre-trained=ImageNet-21k, Evaluation Protocol=linear probe, # Train Params (M)=5.4, # Inference Params (M)=5.42024.1186.197.5