Image Classification on Tiny ImageNet (val)
69.81Top-1 AccuracyAFD
Evaluation Results
| Method | Links | |
|---|---|---|
| AFDTeacher=ResNet34, Student=ResNet342021.02 | 69.81 | |
| KDTeacher=ResNet34, Student=ResNet342021.02 | 69.71 | |
| CRDTeacher=ResNet34, Student=ResNet342021.02 | 69.68 | |
| ATTTeacher=ResNet34, Student=ResNet342021.02 | 69.61 | |
| FitNetTeacher=ResNet34, Student=ResNet342021.02 | 68.92 | |
| AFDTeacher=ResNet34, Student=ResNet182021.02 | 68.8 | |
| RKDTeacher=ResNet34, Student=ResNet342021.02 | 68.46 | |
| CRDTeacher=ResNet34, Student=ResNet182021.02 | 68.19 | |
| KDTeacher=ResNet34, Student=ResNet182021.02 | 68.18 | |
| ATTTeacher=ResNet34, Student=ResNet182021.02 | 67.82 | |
| FitNetTeacher=ResNet34, Student=ResNet182021.02 | 67.79 | |
| RKDTeacher=ResNet34, Student=ResNet182021.02 | 67.72 | |
| TeacherTeacher=ResNet34, Student=ResNet182021.02 | 67.5 | |
| TeacherTeacher=ResNet34, Student=ResNet342021.02 | 67.5 | |
| StudentTeacher=ResNet34, Student=ResNet342021.02 | 67.5 | |
| MoCo V1 + ContrastiveCropArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 65.8 | |
| StudentTeacher=ResNet34, Student=ResNet182021.02 | 65.3 | |
| MoCo V2 + ContrastiveCropArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 64.61 | |
| MoCo V1Arch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 64.52 | |
| SimSiam + ContrastiveCropArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 63.54 | |
| MoCo V2Arch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 63.43 | |
| SimCLR + ContrastiveCropArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 63.08 | |
| SimSiamArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 62.89 | |
| AugMax-DuBIN2021.10 | 62.21 | |
| SimCLRArch.=R50, Epoch=100, Evaluation Protocol=Linear Classification2022.02 | 62.14 | |
| AugMix2021.10 | 61.79 | |
| Normal2021.10 | 61.64 | |
| AugMax-DuBINDeepAugment=true2021.10 | 59.72 | |
| AugMixDeepAugment=true2021.10 | 59.59 | |
| DWAipc=100, Backbone=ResNet-1012024.09 | 57.4 | |
| DWAipc=100, Backbone=ResNet-502024.09 | 56.9 | |
| DWAipc=100, Backbone=ResNet-182024.09 | 56 | |
| CorInfoMaxBackbone=ResNet-50, Evaluation Protocol=Linear Evaluation2022.09 | 54.86 | |
| DWAipc=50, Backbone=ResNet-1012024.09 | 54.7 | |
| DWAipc=50, Backbone=ResNet-502024.09 | 53.7 | |
| DWAipc=50, Backbone=ResNet-182024.09 | 52.8 | |
| SRe2LIPC=100, Backbone=ResNet-1012023.06 | 51.5 | |
| SRe2Lipc=100, Backbone=ResNet-1012024.09 | 51.5 | |
| SRe2LIPC=100, Backbone=ResNet-502023.06 | 51.2 | |
| SRe2Lipc=100, Backbone=ResNet-502024.09 | 51.2 | |
| SpectralBackbone=ResNet-50, Evaluation Protocol=Linear Evaluation2022.09 | 49.86 | |
| SRe2LIPC=100, Backbone=ResNet-182023.06 | 49.7 | |
| SRe2Lipc=100, Backbone=ResNet-182024.09 | 49.7 | |
| SimCLRBackbone=ResNet-50, Evaluation Protocol=Linear Evaluation2022.09 | 48.12 | |
| SimSiamBackbone=ResNet-50, Evaluation Protocol=Linear Evaluation2022.09 | 46.76 | |
| SRe2LIPC=50, Backbone=ResNet-1012023.06 | 42.5 | |
| SRe2Lipc=50, Backbone=ResNet-1012024.09 | 42.5 | |
| SRe2LIPC=50, Backbone=ResNet-502023.06 | 42.2 | |
| SRe2Lipc=50, Backbone=ResNet-502024.09 | 42.2 | |
| SRe2LIPC=50, Backbone=ResNet-182023.06 | 41.1 | |
| SRe2Lipc=50, Backbone=ResNet-182024.09 | 41.1 | |
| DataDAMipc=50, Backbone=ConvNet2024.09 | 28.7 | |
| MTTIPC=502023.06 | 28 | |
| MTTipc=50, Backbone=ConvNet2024.09 | 28 |