Categorical Skin Lesion Classification on HAM10000 (test)
0.8915AccuracyMAE + ViT-H + synth
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MAE + ViT-H + synthBackbone=ViT-H, Pre-training=MAE, Synthetic Augmentation=Conditional Diffusion, Knowledge Distillation=None2026.02 | 0.8915 | 0.8911 | |
| MAE + ViT-L + synthBackbone=ViT-L, Pre-training=MAE, Synthetic Augmentation=Conditional Diffusion, Knowledge Distillation=None2026.02 | 0.8382 | 0.8247 | |
| MAE ViT-H distill to ViT-B + synthBackbone=ViT-B, Pre-training=MAE (Teacher), Synthetic Augmentation=Conditional Diffusion, Knowledge Distillation=Distill from ViT-H2026.02 | 0.8186 | 0.7225 | |
| MAE ViT-H distill EfficientNet-B0 + synthBackbone=EfficientNet-B0, Pre-training=MAE (Teacher), Synthetic Augmentation=Conditional Diffusion, Knowledge Distillation=Distill from ViT-H2026.02 | 0.8058 | 0.7563 | |
| EfficientNet-B0Backbone=EfficientNet-B0, Pre-training=None, Synthetic Augmentation=None, Knowledge Distillation=None2026.02 | 0.7976 | 0.6726 | |
| EfficientNet-B7Backbone=EfficientNet-B7, Pre-training=None, Synthetic Augmentation=None, Knowledge Distillation=None2026.02 | 0.7913 | 0.747 | |
| MAE ViT-H distill to ViT-B (no synth)Backbone=ViT-B, Pre-training=MAE (Teacher), Synthetic Augmentation=None, Knowledge Distillation=Distill from ViT-H2026.02 | 0.7719 | 0.7557 | |
| MAE ViT-H distill to ViT-B + (non-cond.) synthBackbone=ViT-B, Pre-training=MAE (Teacher), Synthetic Augmentation=Non-conditional Diffusion, Knowledge Distillation=Distill from ViT-H2026.02 | 0.7337 | 0.7216 | |
| EfficientNet-B3Backbone=EfficientNet-B3, Pre-training=None, Synthetic Augmentation=None, Knowledge Distillation=None2026.02 | 0.716 | 0.7184 | |
| ViT-B (Baseline)Backbone=ViT-B, Pre-training=None, Synthetic Augmentation=None, Knowledge Distillation=None2026.02 | 0.6748 | 0.6498 | |
| ViT-B + synthBackbone=ViT-B, Pre-training=None, Synthetic Augmentation=Conditional Diffusion, Knowledge Distillation=None2026.02 | 0.6719 | 0.6557 | |
| ViT-L (Baseline)Backbone=ViT-L, Pre-training=None, Synthetic Augmentation=None, Knowledge Distillation=None2026.02 | 0.6579 | 0.6383 |