Knowledge Distillation on Food-101 (test)
35.8Accuracy (k=1)Few-medoids
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Few-medoidsTeacher=ViT-B/16, Student=ViT-Small2026.07 | 35.8 | 51.33 | 59.6 | 70.68 | 74.92 | 78.1 | 80.73 | 83.82 | |
| HerdingTeacher=ViT-B/16, Student=ViT-Small2026.07 | 35.1 | 49.95 | 63.74 | 72.45 | 79.24 | 82.53 | 85.14 | 86.86 | |
| RandomTeacher=ViT-B/16, Student=ViT-Small2026.07 | 21.64 | 36.06 | 51.67 | 68.11 | 76.56 | 81.41 | 84.25 | 86.33 | |
| K-centerTeacher=ViT-B/16, Student=ViT-Small2026.07 | 21.63 | 25.72 | 29.3 | 44.77 | 64.97 | 74.81 | 81.44 | 85.47 | |
| PCA-guided matchingTeacher=ViT-B/16, Student=ViT-Small2026.07 | 13.5 | 22.4 | 36.36 | 54.62 | 69.09 | 76.89 | 81.52 | 85.1 | |
| Few-medoidsTeacher=ResNet-34, Student=ResNet-182026.07 | 3.56 | 5.94 | 9.97 | 16.73 | 28.21 | 43.36 | 59.73 | 70.13 | |
| PCA-guided matchingTeacher=ResNet-34, Student=ResNet-182026.07 | 2.85 | 4.65 | 7.39 | 12.19 | 22.53 | 37.88 | 56.96 | 69.7 | |
| HerdingTeacher=ResNet-34, Student=ResNet-182026.07 | 2.78 | 5.17 | 8.16 | 11.48 | 20.23 | 35.33 | 56.17 | 69.64 | |
| K-centerTeacher=ResNet-34, Student=ResNet-182026.07 | 2.54 | 2.43 | 2.81 | 3.72 | 5.87 | 12.59 | 30.74 | 58.37 | |
| RandomTeacher=ResNet-34, Student=ResNet-182026.07 | 2.54 | 4.09 | 6.5 | 10.37 | 18.19 | 33.42 | 55.06 | 69.09 | |
| Few-medoidsTeacher=ViT-B/16, Student=ResNet-502026.07 | 1.45 | 2.3 | 4.13 | 8.11 | 22.35 | 36.36 | 51.07 | 65.83 | |
| HerdingTeacher=ViT-B/16, Student=ResNet-502026.07 | 1.21 | 2.24 | 3.1 | 5.8 | 12.06 | 25.9 | 46.97 | 65.26 | |
| K-centerTeacher=ViT-B/16, Student=ResNet-502026.07 | 1.18 | 1.66 | 1.8 | 2.41 | 4.03 | 8.56 | 20.84 | 47.19 | |
| RandomTeacher=ViT-B/16, Student=ResNet-502026.07 | 1.18 | 2.13 | 2.84 | 4.83 | 11.18 | 24.45 | 42.91 | 63.36 | |
| PCA-guided matchingTeacher=ViT-B/16, Student=ResNet-502026.07 | 1.02 | 1.76 | 1.96 | 3.02 | 7.33 | 15.27 | 33.69 | 56.01 |