Image Classification on TinyImageNet
92AccuracyOCD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OCDArchitecture=DeiT-B/16-D, Ensemble count=52022.10 | 92 | — | 0.65 | |
| Swin L/4Architecture=Swin L/42022.10 | 91.35 | — | — | |
| OCDArchitecture=DeiT-B/16-D, Ensemble count=12022.10 | 90.8 | — | 0.65 | |
| TentArchitecture=DeiT-B/16-D, Number of iterations=102022.10 | 88.2 | — | 0.7 | |
| TentArchitecture=DeiT-B/16-D, Number of iterations=302022.10 | 88.2 | — | 0.07 | |
| TentArchitecture=DeiT-B/16-D, Number of iterations=12022.10 | 88.15 | — | 0.71 | |
| DeiT-B/16-DArchitecture=DeiT-B/16-D2022.10 | 87.29 | — | 0.71 | |
| WaveMix-192/16 (level 3)Input Resolution=128 x 128, Pre-trained on ImageNet-1k=true, Augmentation=TrivialAugment [78]2022.05 | 77.49 | — | — | |
| B-12/Wi-1024 + DA + TTABlocks=12, Width=1024, Data Augmentation=true, Test-Time Augmentation=true, Pre-training=ImageNet21k, Evaluation Protocol=Fine-tuning2023.06 | 73.1 | — | — | |
| LeRaCModel=CvT-13 (pre-trained), Training Regime=LeRaC (ours)2022.05 | 71.34 | — | — | |
| conventionalModel=CvT-13 (pre-trained), Training Regime=conventional2022.05 | 70.71 | — | — | |
| B-12/Wi-1024 + DABlocks=12, Width=1024, Data Augmentation=true, Test-Time Augmentation=false, Pre-training=ImageNet21k, Evaluation Protocol=Fine-tuning2023.06 | 69.9 | — | — | |
| CBSModel=CvT-13 (pre-trained), Training Regime=CBS2022.05 | 68.41 | — | — | |
| TeacherTeacher Architecture=ResNet-34, Student Architecture=ResNet-182023.09 | 66.44 | — | — | |
| ResNet-18Params(M)=11.7, FLOPs(M)=1800, Notes=Verified across re-implementations2025.12 | 65 | — | — | |
| KvLIFNetwork Architecture=VGG-13, Timestep=62026.03 | 64.82 | — | — | |
| CPT-SNNNetwork Architecture=VGG-13, Timestep=82026.03 | 64.78 | — | — | |
| WaveMix-244/12 (level 2)Input Resolution=64 x 64, Pre-trained on ImageNet-1k=false, Augmentation=TrivialAugment [78]2022.05 | 64.51 | — | — | |
| NAYERTeacher Architecture=ResNet-34, Student Architecture=ResNet-18, E=3002023.09 | 64.17 | — | — | |
| CLIFNetwork Architecture=VGG-13, Timestep=62026.03 | 64.13 | — | — | |
| SpaceshipNetTeacher Architecture=ResNet-34, Student Architecture=ResNet-182023.09 | 64.04 | — | — | |
| KvLIFNetwork Architecture=VGG-13, Timestep=42026.03 | 64.03 | — | — | |
| WaveMix-Lite/WaveMix-32Params(M)=1–2, FLOPs(M)=250, Notes=Reported in WaveMix paper2025.12 | 64 | — | — | |
| CPT-SNNNetwork Architecture=VGG-13, Timestep=42026.03 | 63.39 | — | — | |
| CLIFNetwork Architecture=VGG-13, Timestep=42026.03 | 63.16 | — | — | |
| B-6/Wi-1024 + DABlocks=6, Width=1024, Data Augmentation=true, Test-Time Augmentation=false, Pre-training=ImageNet21k, Evaluation Protocol=Fine-tuning2023.06 | 62.7 | — | — | |
| MD-SNNModel=ResNet34, Precision (W / U)=8 / 8, Timestep=42025.12 | 60.59 | — | — | |
| MixNet-SParams(M)=4.1, FLOPs(M)=256, Notes=timm community runs2025.12 | 60 | — | — | |
| MD-SNNModel=ResNet34, Precision (W / U)=4 / 4, Timestep=42025.12 | 59.9 | — | — | |
| TinyNet-AParams(M)=6.2, FLOPs(M)=339, Notes=timm community runs2025.12 | 59 | — | — | |
| KD+ATS+EnsTeacher=WRN50-2, Student=MV22022.10 | 58.47 | 63.54 | — | |
| MobileNetV2Params(M)=2.2, FLOPs(M)=330, Notes=Common open-source benchmarks2025.12 | 58 | — | — | |
| LeRaCModel=ResNet-18, Training Regime=LeRaC (ours)2022.05 | 57.86 | — | — | |
| conventionalModel=ResNet-18, Training Regime=conventional2022.05 | 57.41 | — | — | |
| ResKDTeacher=WRN50-2, Student=MV22022.10 | 57.32 | 62.26 | — | |
| ASGLNetwork Architecture=VGG-13, Timestep=82026.03 | 56.81 | — | — | |
| ASGLNetwork Architecture=VGG-13, Timestep=42026.03 | 56.57 | — | — | |
| LeRaCModel=Wide ResNet-50, Training Regime=LeRaC (ours)2022.05 | 56.48 | — | — | |
| EnsTeacher=WRN50-2, Student=MV22022.10 | 56.4 | 61.82 | — | |
| conventionalModel=Wide ResNet-50, Training Regime=conventional2022.05 | 55.97 | — | — | |
| CBSModel=ResNet-18, Training Regime=CBS2022.05 | 55.49 | — | — | |
| Joint A-SNNNetwork Architecture=VGG-16, Timestep=42026.03 | 55.39 | — | — | |
| ShuffleNet V2 (0.5x)Params(M)=1.26, FLOPs(M)=150, Notes=Public leaderboard reports2025.12 | 55 | — | — | |
| KD+ATSTeacher=WRN50-2, Student=MV22022.10 | 54.11 | 60.88 | — | |
| SpikeSimModel=VGG16, Precision (W / U)=8 / 32, Timestep=102025.12 | 54.03 | — | — | |
| ST-KDTeacher=WRN50-2, Student=MV22022.10 | 52.93 | 59.77 | — | |
| TAKDTeacher=WRN50-2, Student=MV22022.10 | 52.44 | 58.87 | — | |
| KDTeacher=WRN50-2, Student=MV22022.10 | 52.33 | 58.89 | — | |
| ESKDTeacher=WRN50-2, Student=MV22022.10 | 52.15 | 59.01 | — | |
| KD+ATS+EnsTeacher=WRN50-2, Student=SFV22022.10 | 52.14 | 63.54 | — | |
| NoKDTeacher=WRN50-2, Student=MV22022.10 | 52.03 | 57.94 | — | |
| ResKDTeacher=WRN50-2, Student=SFV22022.10 | 51.93 | 62.26 | — | |
| Mixed Barlow TwinsBackbone=ResNet-50, Epochs=2000, Evaluation Protocol=linear2023.12 | 51.84 | — | — | |
| SCKDTeacher=WRN50-2, Student=MV22022.10 | 51.83 | 59.04 | — | |
| Mixed Barlow TwinsBackbone=ResNet-18, Epochs=2000, linear=true2023.12 | 51.67 | — | — | |
| Mixed Barlow TwinsBackbone=ResNet-18, Epochs=1000, linear=true2023.12 | 51.48 | — | — | |
| BYOLBackbone=ResNet-18, Epochs=1000, linear=true2023.12 | 51 | — | — | |
| EnsTeacher=WRN50-2, Student=SFV22022.10 | 50.69 | 61.82 | — | |
| Mixed Barlow TwinsBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=linear2023.12 | 50.59 | — | — | |
| KD+ATSTeacher=WRN50-2, Student=SFV22022.10 | 50.03 | 60.88 | — | |
| ST-KDTeacher=WRN50-2, Student=SFV22022.10 | 49.59 | 59.77 | — | |
| SimCLRBackbone=ResNet-18, Epochs=1000, linear=true2023.12 | 48.84 | — | — | |
| SCKDTeacher=WRN50-2, Student=SFV22022.10 | 48.76 | 59.04 | — | |
| TAKDTeacher=WRN50-2, Student=SFV22022.10 | 48.71 | 58.87 | — | |
| KDTeacher=WRN50-2, Student=SFV22022.10 | 48.48 | 58.89 | — | |
| ESKDTeacher=WRN50-2, Student=SFV22022.10 | 48.34 | 59.01 | — | |
| CBSModel=Wide ResNet-50, Training Regime=CBS2022.05 | 48.3 | — | — | |
| W-MSEBackbone=ResNet-18, Epochs=1000, linear=true2023.12 | 48.2 | — | — | |
| B-6/Wi-1024Blocks=6, Width=1024, Data Augmentation=false, Test-Time Augmentation=false, Pre-training=ImageNet21k, Evaluation Protocol=Fine-tuning2023.06 | 47.1 | — | — | |
| GlimmerNetParams(M)=0.24, FLOPs(M)=28, Notes=Scaled-up configuration2025.12 | 47.08 | — | — | |
| COSMOSalpha=5, heterogeneity=Dirichlet, round=final2026.05 | 46.9 | — | — | |
| Barlow TwinsBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=linear2023.12 | 46.86 | — | — | |
| SimCLRBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=linear2023.12 | 46.34 | — | — | |
| COSMOSdata heterogeneity=Dirichlet, alpha=100, performance type=Final-round2026.05 | 46.2 | — | — | |
| NoKDTeacher=WRN50-2, Student=SFV22022.10 | 45.79 | 57.94 | — | |
| MINTModel=ResNet34, Precision (W / U)=4 / 4, Timestep=42025.12 | 44.94 | — | — | |
| MINTModel=ResNet34, Precision (W / U)=8 / 8, Timestep=42025.12 | 42.94 | — | — | |
| Mixed Barlow TwinsBackbone=ResNet-50, Epochs=2000, Evaluation Protocol=k-NN2023.12 | 42.21 | — | — | |
| Barlow TwinsBackbone=ResNet-18, Epochs=1000, linear=true2023.12 | 41.8 | — | — | |
| MoCoBackbone=ResNet-18, Evaluation Protocol=Linear evaluation2025.09 | 41.23 | — | — | |
| BYOLBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=linear2023.12 | 41.02 | — | — | |
| Mixed Barlow TwinsBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=k-NN2023.12 | 40.52 | — | — | |
| KD+ATS+EnsTeacher=WRN50-2, Student=ANet2022.10 | 40.42 | 63.54 | — | |
| Kernel VICReg—RQBackbone=ResNet-18, Evaluation Protocol=Linear evaluation, Kernel=RQ2025.09 | 40.38 | — | — | |
| Kernel VICReg—LaplacianBackbone=ResNet-18, Evaluation Protocol=Linear evaluation, Kernel=Laplacian2025.09 | 40.12 | — | — | |
| EnsTeacher=WRN50-2, Student=ANet2022.10 | 39.37 | 61.82 | — | |
| ResKDTeacher=WRN50-2, Student=ANet2022.10 | 38.66 | 62.26 | — | |
| Kernel VICReg—RBFBackbone=ResNet-18, Evaluation Protocol=Linear evaluation, Kernel=RBF2025.09 | 38.21 | — | — | |
| Mixed Barlow TwinsBackbone=ResNet-18, Epochs=2000, k-NN=true2023.12 | 38.11 | — | — | |
| SimCLRBackbone=ResNet-18, Evaluation Protocol=Linear evaluation2025.09 | 37.83 | — | — | |
| Barlow TwinsBackbone=ResNet-50, Epochs=1000, Evaluation Protocol=k-NN2023.12 | 37.66 | — | — | |
| Whole DatasetImg/Cls=N/A, Ratio (%)=1002023.07 | 37.6 | — | — | |
| Mixed Barlow TwinsBackbone=ResNet-18, Epochs=1000, k-NN=true2023.12 | 37.52 | — | — | |
| Kernel VICReg—LinearBackbone=ResNet-18, Evaluation Protocol=Linear evaluation, Kernel=Linear2025.09 | 37.48 | — | — | |
| KD+ATSTeacher=WRN50-2, Student=ANet2022.10 | 37.42 | 60.88 | — | |
| COMETdata heterogeneity=Dirichlet, alpha=100, performance type=Final-round2026.05 | 37.1 | — | — | |
| BYOLBackbone=ResNet-18, Evaluation Protocol=Linear evaluation2025.09 | 36.31 | — | — | |
| BYOLBackbone=ResNet-18, Epochs=1000, k-NN=true2023.12 | 36.24 | — | — | |
| TAKDTeacher=WRN50-2, Student=ANet2022.10 | 36.2 | 58.87 | — | |
| ST-KDTeacher=WRN50-2, Student=ANet2022.10 | 36.16 | 59.77 | — |