Image Classification on ImageNet 1K (val) (Top-1 Metric Only)
82.2Top-1 AccuracyMANIFOLD
Evaluation results
| Method | Links | |
|---|---|---|
| MANIFOLDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 82.2 | |
| SpectralKDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 82.2 | |
| SRDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 82.1 | |
| DEARKDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 81.5 | |
| HARDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 81.3 | |
| HARDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 81.2 | |
| USKDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Small, Student Parameters=22M2024.12 | 80.8 | |
| DeiT-SmallStudent Architecture=DeiT-Small, Student Parameters=22M2024.12 | 79.9 | |
| SpectralKDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 77.4 | |
| SRDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 77.2 | |
| MANIFOLDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 76.5 | |
| MASKEDKDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 75.9 | |
| USKDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 75 | |
| DEARKDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 74.8 | |
| HARDTeacher Architecture=RegNetY-16GF, Teacher Parameters=84M, Teacher Top-1 (%)=82.9, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 74.5 | |
| HARDTeacher Architecture=CaiT-S24, Teacher Parameters=47M, Teacher Top-1 (%)=83.4, Student Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 74.5 | |
| DeiT-TinyStudent Architecture=DeiT-Tiny, Student Parameters=5M2024.12 | 72.2 |