Medical Image Classification on BTC
82.49AccuracyReprogramming Distillation
Evaluation results
| Method | Links | |
|---|---|---|
| Reprogramming DistillationStudent=MobileNet, Teacher=LVM-Med2024.07 | 82.49 | |
| RDStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 82.49 | |
| DRDTeacher=LVM-Med 80.71, Student=MobileNet2026.05 | 82.49 | |
| Reprogramming DistillationStudent=ResNet18, Teacher=LVM-Med2024.07 | 81.98 | |
| RDStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 81.98 | |
| LoRKDPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 81.47 | |
| Reprogramming DistillationStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 80.71 | |
| HintStudent=ResNet18, Teacher=LVM-Med2024.07 | 80.71 | |
| DRDTeacher=PMC-CLIP 80.20, Student=ResNet182026.05 | 80.71 | |
| STL-KDPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 80.46 | |
| MGDStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 80.46 | |
| Reprogramming DistillationStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 80.46 | |
| RDStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 80.46 | |
| FoundationPre-train=Radimagenet, Params(M)=23.51, Comp. Ratio=/2024.04 | 80.2 | |
| AdaptFormerStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 80.2 | |
| MTLPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 79.95 | |
| Reprogramming DistillationStudent=ShuffleNet, Teacher=Densenet1212024.07 | 79.95 | |
| CrdStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 79.95 | |
| Reprogramming DistillationStudent=MobileNet, Teacher=Densenet1212024.07 | 79.95 | |
| AdaptFormerStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 79.95 | |
| DRDTeacher=RadImageNet 80.46, Student=ShuffleNet2026.05 | 79.95 | |
| KFPre-train=Radimagenet, Params(M)=1.60, Comp. Ratio=6.81%2024.04 | 79.7 | |
| LoRKDPre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 79.7 | |
| Reprogramming DistillationStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 79.7 | |
| Reprogramming DistillationStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 79.44 | |
| STLPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.93 | |
| MTL-KDPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.93 | |
| LPTStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 78.93 | |
| AdaptFormerStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 78.93 | |
| VQTStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 78.93 | |
| MoCo-MTLPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.68 | |
| MTLPre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.68 | |
| Reprogramming DistillationStudent=ResNet18, Teacher=Densenet1212024.07 | 78.68 | |
| SemCKDStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 78.68 | |
| MTL-KDPre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.62 | |
| Aligned-MTLPre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 78.43 | |
| SemCKDStudent=ResNet18, Teacher=LVM-Med2024.07 | 78.43 | |
| MeLoStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 78.43 | |
| LPTStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 78.43 | |
| FoundationPre-train=Med-MT, Params(M)=23.51, Comp. Ratio=/2024.04 | 78.17 | |
| SemCKDStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 78.17 | |
| VIDStudent=MobileNet, Teacher=Densenet1212024.07 | 78.17 | |
| VIDStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 77.92 | |
| MGDStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 77.92 | |
| HintStudent=MobileNet, Teacher=LVM-Med2024.07 | 77.92 | |
| VPTStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 77.92 | |
| VQTStudent Backbone=ResNet18, Foundation Model=LVM-Med2024.07 | 77.92 | |
| VanillaTeacher=PMC-CLIP 80.20, Student=ResNet182026.05 | 77.92 | |
| LoRKDPre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 77.66 | |
| HintStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 77.66 | |
| NormStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 77.66 | |
| VIDStudent=ResNet18, Teacher=Densenet1212024.07 | 77.66 | |
| VPTStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 77.66 | |
| Aligned-MTLPre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 77.42 | |
| FoundationPre-train=MedMnist, Params(M)=23.51, Comp. Ratio=/2024.04 | 77.41 | |
| SemCKDStudent=ResNet18, Teacher=Densenet1212024.07 | 77.41 | |
| VIDStudent=ResNet18, Teacher=LVM-Med2024.07 | 77.41 | |
| VIDStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 77.41 | |
| VIDStudent=ShuffleNet, Teacher=Densenet1212024.07 | 77.41 | |
| SemCKDStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 77.41 | |
| SemCKDStudent=MobileNet, Teacher=Densenet1212024.07 | 77.41 | |
| VIDStudent=MobileNet, Teacher=LVM-Med2024.07 | 77.41 | |
| SemCKDStudent=MobileNet, Teacher=LVM-Med2024.07 | 77.41 | |
| MoCo-MTLPre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 77.16 | |
| VIDStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 77.16 | |
| HintStudent=ResNet18, Teacher=Densenet1212024.07 | 77.16 | |
| SemCKDStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 77.16 | |
| HintStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 77.16 | |
| SemCKDStudent=ShuffleNet, Teacher=Densenet1212024.07 | 77.16 | |
| MGDStudent=MobileNet, Teacher=Densenet1212024.07 | 77.16 | |
| KFPre-train=MedMnist, Params(M)=1.60, Comp. Ratio=6.81%2024.04 | 77.15 | |
| MGDStudent=ResNet18, Teacher=Densenet1212024.07 | 76.9 | |
| MGDStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 76.9 | |
| CrdStudent=ShuffleNet, Teacher=Densenet1212024.07 | 76.9 | |
| CrdStudent=MobileNet, Teacher=Densenet1212024.07 | 76.9 | |
| HintStudent=MobileNet, Teacher=Densenet1212024.07 | 76.9 | |
| MeLoStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 76.9 | |
| VQTStudent Backbone=ShuffleNet, Foundation Model=LVM-Med2024.07 | 76.9 | |
| MTLPre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 76.65 | |
| MGDStudent=ShuffleNet, Teacher=Densenet1212024.07 | 76.65 | |
| VIDStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 76.65 | |
| HintStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 76.65 | |
| MeLoStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 76.65 | |
| VPTStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 76.65 | |
| MoCo-MTLPre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 76.4 | |
| CrdStudent=ResNet18, Teacher=Densenet1212024.07 | 76.4 | |
| LPTStudent Backbone=MobileNet, Foundation Model=LVM-Med2024.07 | 76.4 | |
| MTL-KDPre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 75.89 | |
| MGDStudent=ResNet18, Teacher=PMC-CLIP2024.07 | 75.89 | |
| Aligned-MTLPre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 75.63 | |
| HintStudent=ShuffleNet, Teacher=Densenet1212024.07 | 75.63 | |
| BaselinePre-train=Radimagenet, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 75.38 | |
| BaselinePre-train=MedMnist, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 75.38 | |
| BaselinePre-train=Med-MT, Params(M)=1.25, Comp. Ratio=5.32%2024.04 | 75.38 | |
| CrdStudent=ResNet18, Teacher=LVM-Med2024.07 | 75.13 | |
| NormStudent=ShuffleNet, Teacher=PMC-CLIP2024.07 | 75.13 | |
| NormStudent=ShuffleNet, Teacher=LVM-Med2024.07 | 75.13 | |
| KFPre-train=Med-MT, Params(M)=1.60, Comp. Ratio=6.81%2024.04 | 74.87 | |
| CrdStudent=MobileNet, Teacher=LVM-Med2024.07 | 74.87 | |
| NormStudent=MobileNet, Teacher=PMC-CLIP2024.07 | 74.62 |