Knowledge Distillation on Oxford Flowers 102 (test)
97.25AccuracyRandom
Evaluation Results
| Method | Links | |
|---|---|---|
| RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.07 | 97.25 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.07 | 97.06 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.07 | 96.62 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.07 | 96.58 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=82026.07 | 95.54 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.07 | 93.81 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.07 | 93.67 | |
| RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.07 | 92.15 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.07 | 91.24 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=42026.07 | 89.54 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.07 | 83.27 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.07 | 80.61 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.07 | 80.56 | |
| RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.07 | 77.62 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=22026.07 | 75.51 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.07 | 72.61 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.07 | 71.63 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.07 | 66.87 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.07 | 66.49 | |
| RandomTeacher Model=ViT-B/16, Student Model=ViT-Small, k (number of samples per class)=12026.07 | 66.49 | |
| PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.07 | 52.13 | |
| RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.07 | 51.69 | |
| Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.07 | 51.44 | |
| K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.07 | 51.16 | |
| HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=82026.07 | 50.9 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.07 | 38.89 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.07 | 38.83 | |
| HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.07 | 38.37 | |
| Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.07 | 37.12 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.07 | 37 | |
| PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.07 | 36.1 | |
| RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.07 | 35.73 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.07 | 35.5 | |
| RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=82026.07 | 35.15 | |
| K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=42026.07 | 33.34 | |
| RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.07 | 25.64 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.07 | 25.63 | |
| Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.07 | 25.09 | |
| HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.07 | 25.09 | |
| RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.07 | 22.52 | |
| PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.07 | 22.23 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.07 | 22.01 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.07 | 22 | |
| K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=22026.07 | 20.87 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=42026.07 | 19.82 | |
| HerdingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.07 | 14.53 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.07 | 14.05 | |
| Few-medoidsTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.07 | 13.91 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.07 | 13.45 | |
| K-centerTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.07 | 12.86 | |
| RandomTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.07 | 12.86 | |
| PCA-guided matchingTeacher Model=ResNet-34, Student Model=ResNet-18, k (number of samples per class)=12026.07 | 11.71 | |
| RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.07 | 10.47 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.07 | 9.53 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=22026.07 | 8.28 | |
| Few-medoidsTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.07 | 2.09 | |
| HerdingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.07 | 1.9 | |
| PCA-guided matchingTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.07 | 1.88 | |
| K-centerTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.07 | 1.57 | |
| RandomTeacher Model=ViT-B/16, Student Model=ResNet-50, k (number of samples per class)=12026.07 | 1.57 |