List your company
ResearchFormerly WizWand

Knowledge Distillation on Oxford Flowers 102 (test)

97.25AccuracyRandom
-2.257223.576449.4175.2436Jul 7, 2026
Updated 4mo ago

Evaluation results

MethodLinks
RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.0797.25
HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.0797.06
K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.0796.62
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.0796.58
Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.0795.54
HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.0793.81
K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.0793.67
RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.0792.15
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.0791.24
Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.0789.54
HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.0783.27
K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.0780.61
Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.0780.56
RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.0777.62
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.0775.51
Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.0772.61
HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.0771.63
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.0766.87
K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.0766.49
RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.0766.49
PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.0752.13
RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.0751.69
Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.0751.44
K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.0751.16
HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.0750.9
Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.0738.89
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.0738.83
HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.0738.37
Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.0737.12
K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.0737
PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.0736.1
RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.0735.73
HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.0735.5
RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.0735.15
K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.0733.34
RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.0725.64
Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.0725.63
Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.0725.09
HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.0725.09
RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.0722.52
PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.0722.23
K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.0722.01
HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.0722
K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.0720.87
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.0719.82
HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.0714.53
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.0714.05
Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.0713.91
HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.0713.45
K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.0712.86
RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.0712.86
PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.0711.71
RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.0710.47
Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.079.53
K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.078.28
Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.072.09
HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.071.9
PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.071.88
K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.071.57
RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.071.57