Image Classification on SVHN
99.3AccuracyMLCD
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MLCDPre-training Data=LAION-400M, Backbone=ViT-L/14, Evaluation Protocol=Linear Probe2024.07 | 99.3 | — | — | — | — | — | — | — | — | — | — | — | |
| CLIPPre-training Data=WIT-400M, Backbone=ViT-L/14, Evaluation Protocol=Linear Probe2024.07 | 99.2 | — | — | — | — | — | — | — | — | — | — | — | |
| CLIP+Pre-training Data=WIT-400M, Backbone=ViT-L/14, Evaluation Protocol=Linear Probe2024.07 | 99.2 | — | — | — | — | — | — | — | — | — | — | — | |
| OpenCLIPPre-training Data=LAION-400M, Backbone=ViT-L/14, Evaluation Protocol=Linear Probe2024.07 | 99.2 | — | — | — | — | — | — | — | — | — | — | — | |
| UNICOMPre-training Data=LAION-400M, Backbone=ViT-L/14, Evaluation Protocol=Linear Probe2024.07 | 99.2 | — | — | — | — | — | — | — | — | — | — | — | |
| WaveMix-192/16 (level 3)Input Resolution=128 x 128, Pre-trained on ImageNet-1k=true, Augmentation=None2022.05 | 98.79 | — | — | — | — | — | — | — | — | — | — | — | |
| WaveMix-Lite-144/15Input Resolution=32 x 32, Pre-trained on ImageNet-1k=false, Augmentation=None2022.05 | 98.73 | — | — | — | — | — | — | — | — | — | — | — | |
| ASAP-CDFLOPS(M)=5732021.07 | 98.01 | — | — | 0.484 | — | — | — | — | — | — | — | — | |
| Multiple modelsBackbone=ViT-L/142022.08 | 98 | — | — | — | — | — | — | — | — | — | — | — | |
| L2P-AHILBag Size=162024.11 | 97.91 | — | — | — | — | — | — | — | — | — | — | — | |
| fine-tunedBackbone=ViT-L/142026.02 | 97.9 | — | — | — | — | — | — | — | — | — | — | — | |
| µDARTSFLOPS(M)=6022021.07 | 97.88 | — | — | 0.127 | — | — | — | — | — | — | — | — | |
| L2P-AHILBag Size=322024.11 | 97.88 | — | — | — | — | — | — | — | — | — | — | — | |
| theta_B fine-tuneBackbone=ViT-L/142025.10 | 97.8 | — | — | — | — | — | — | — | — | — | — | — | |
| P-DARTS-CDFLOPS(M)=5322021.07 | 97.79 | — | — | 0.266 | — | — | — | — | — | — | — | — | |
| Fully SupervisedFully Supervised=true2024.11 | 97.77 | — | — | — | — | — | — | — | — | — | — | — | |
| L2P-AHILBag Size=642024.11 | 97.74 | — | — | — | — | — | — | — | — | — | — | — | |
| Multiple modelsBackbone=ViT-B/162022.08 | 97.7 | — | — | — | — | — | — | — | — | — | — | — | |
| FixMatchData Partitioning=Centralized, Number of Supervised=10002021.06 | 97.7 | — | — | — | — | — | — | — | — | — | — | — | |
| θBmode=fine-tune2026.02 | 97.7 | — | — | — | — | — | — | — | — | — | — | — | |
| Full-tuningAvg. Params (M)=86.04, learning rate=0.1x2022.05 | 97.67 | — | — | — | — | — | — | — | — | — | — | — | |
| L2P-AHILBag Size=1282024.11 | 97.67 | — | — | — | — | — | — | — | — | — | — | — | |
| fine-tunedBackbone=ViT-B/162026.02 | 97.6 | — | — | — | — | — | — | — | — | — | — | — | |
| UDAData Partitioning=Centralized, Number of Supervised=10002021.06 | 97.5 | — | — | — | — | — | — | — | — | — | — | — | |
| FixMatchData Partitioning=Centralized, Number of Supervised=2502021.06 | 97.5 | — | — | — | — | — | — | — | — | — | — | — | |
| HeteroFLData Partitioning=IID2021.06 | 97.5 | — | — | — | — | — | — | — | — | — | — | — | |
| Fine-Tuned*Note=Upper-bound2025.12 | 97.5 | — | — | — | — | — | — | — | — | — | — | — | |
| theta_B fine-tuneBackbone=ViT-B/162025.10 | 97.45 | — | — | — | — | — | — | — | — | — | — | — | |
| Conditional Channel Gated NetworksEvaluation Protocol=Task-IL, Number of runs=52020.03 | 97.4 | — | — | — | — | — | — | — | — | — | — | — | |
| ReMixMatchData Partitioning=Centralized, Number of Supervised=10002021.06 | 97.4 | — | — | — | — | — | — | — | — | — | — | — | |
| Joint patchingBackbone=ViT-L/142022.08 | 97.3 | — | — | — | — | — | — | — | — | — | — | — | |
| Fully SupervisedData Partitioning=Centralized2021.06 | 97.3 | — | — | — | — | — | — | — | — | — | — | — | |
| fine-tunedBackbone=ViT-B/322026.02 | 97.3 | — | — | — | — | — | — | — | — | — | — | — | |
| Multiple modelsBackbone=ViT-B/322022.08 | 97.2 | — | — | — | — | — | — | — | — | — | — | — | |
| SCEMethod=SCE2026.02 | 97.2 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=4000, OOD_dataset=LSUN2020.07 | 97.15 | — | — | — | — | — | — | — | — | — | — | — | |
| ReMixMatchData Partitioning=Centralized, Number of Supervised=2502021.06 | 97.1 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=4000, OOD_dataset=Gaussian2020.07 | 97.07 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=4000, OOD_dataset=Uniform2020.07 | 97.04 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=4000, OOD_dataset=TIN2020.07 | 97.01 | — | — | — | — | — | — | — | — | — | — | — | |
| DashTraining setting=from scratch, Labels per category=42022.02 | 97 | — | — | — | — | — | — | — | — | — | — | — | |
| L2P-AHILBag Size=2562024.11 | 96.98 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=4000, OOD_dataset=Gaussian2020.07 | 96.97 | — | — | — | — | — | — | — | — | — | — | — | |
| DLLPBag Size=322024.11 | 96.93 | — | — | — | — | — | — | — | — | — | — | — | |
| SemiFLData Partitioning=IID, Number of Supervised=10002021.06 | 96.9 | — | — | — | — | — | — | — | — | — | — | — | |
| DLLPBag Size=162024.11 | 96.9 | — | — | — | — | — | — | — | — | — | — | — | |
| AdaptFormer-64Avg. Params (M)=1.262022.05 | 96.89 | — | — | — | — | — | — | — | — | — | — | — | |
| LLP-VATBag Size=162024.11 | 96.88 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=4000, OOD_dataset=Uniform2020.07 | 96.86 | — | — | — | — | — | — | — | — | — | — | — | |
| PC-DARTS-CDFLOPS(M)=5572021.07 | 96.82 | — | — | 0.279 | — | — | — | — | — | — | — | — | |
| HeteroFLData Partitioning=Non-IID, Dir(0.3)2021.06 | 96.8 | — | — | — | — | — | — | — | — | — | — | — | |
| SemiFLData Partitioning=IID, Number of Supervised=2502021.06 | 96.8 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=4000, OOD_dataset=LSUN2020.07 | 96.75 | — | — | — | — | — | — | — | — | — | — | — | |
| ROTBag Size=642024.11 | 96.75 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=4000, OOD_dataset=TIN2020.07 | 96.73 | — | — | — | — | — | — | — | — | — | — | — | |
| SWAGArchitecture=ResNet182021.02 | 96.72 | 0.13 | 1.6 | — | — | — | — | — | — | — | — | — | |
| GOLD-NAS-I-CDFLOPS(M)=4632021.07 | 96.71 | — | — | 0.303 | — | — | — | — | — | — | — | — | |
| DST (FixMatch)Training setting=from scratch, Labels per category=42022.02 | 96.7 | — | — | — | — | — | — | — | — | — | — | — | |
| LLP-VATBag Size=322024.11 | 96.68 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=1000, OOD_dataset=TIN2020.07 | 96.65 | — | — | — | — | — | — | — | — | — | — | — | |
| DLLPBag Size=642024.11 | 96.64 | — | — | — | — | — | — | — | — | — | — | — | |
| Mean TeacherData Partitioning=Centralized, Number of Supervised=10002021.06 | 96.6 | — | — | — | — | — | — | — | — | — | — | — | |
| ReMixMatchTraining setting=from scratch, Labels per category=42022.02 | 96.6 | — | — | — | — | — | — | — | — | — | — | — | |
| ViT-SOM-cls# Params=5.4M2025.03 | 96.6 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=1000, OOD_dataset=LSUN2020.07 | 96.51 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=1000, OOD_dataset=Gaussian2020.07 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | |
| MixMatchData Partitioning=Centralized, Number of Supervised=10002021.06 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | |
| FixMatchTraining setting=from scratch, Labels per category=42022.02 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | |
| Multi-Task Curriculum Frameworklabeled_samples=1000, OOD_dataset=Uniform2020.07 | 96.47 | — | — | — | — | — | — | — | — | — | — | — | |
| VSDArchitecture=ResNet182021.02 | 96.41 | 0.14 | 0.3 | — | — | — | — | — | — | — | — | — | |
| HATEvaluation Protocol=Task-IL, Number of runs=52020.03 | 96.4 | — | — | — | — | — | — | — | — | — | — | — | |
| Mean TeacherData Partitioning=Centralized, Number of Supervised=2502021.06 | 96.4 | — | — | — | — | — | — | — | — | — | — | — | |
| LLP-VATBag Size=642024.11 | 96.38 | — | — | — | — | — | — | — | — | — | — | — | |
| D.EArchitecture=ResNet182021.02 | 96.36 | 0.171 | 2 | — | — | — | — | — | — | — | — | — | |
| IndividualBackbone=ViT-B/16, Pre-trained=ImageNet-21k, Number of Merged Models=12024.05 | 96.22 | — | — | — | — | — | — | — | — | — | — | — | |
| AdaptFormer-4Avg. Params (M)=0.152022.05 | 96.19 | — | — | — | — | — | — | — | — | — | — | — | |
| GOLD-NAS-A-CDFLOPS(M)=2782021.07 | 96.13 | — | — | 0.333 | — | — | — | — | — | — | — | — | |
| VDArchitecture=ResNet182021.02 | 96.11 | 0.164 | 1.7 | — | — | — | — | — | — | — | — | — | |
| MDA AMBackbone=ViT-B/32, Rotation Alignment=true2025.11 | 96.1 | — | — | — | — | — | — | — | — | — | — | — | |
| AutoRGNBackbone=ResNet-502026.01 | 96.08 | — | — | — | — | — | — | — | — | — | — | — | |
| RDARTS-CDFLOPS(M)=6052021.07 | 96.07 | — | — | 0.189 | — | — | — | — | — | — | — | — | |
| ELRGArchitecture=ResNet182021.02 | 96.03 | 0.145 | 0.3 | — | — | — | — | — | — | — | — | — | |
| L1-SPBackbone=ResNet-502026.01 | 96.01 | — | — | — | — | — | — | — | — | — | — | — | |
| MixMatchData Partitioning=Centralized, Number of Supervised=2502021.06 | 96 | — | — | — | — | — | — | — | — | — | — | — | |
| DE-VGNEnsemble Size (M)=52026.02 | 96 | — | 1.6 | — | — | — | — | — | — | — | 95.7 | 0.004 | |
| Baselinelabeled_samples=1000, OOD_dataset=Gaussian2020.07 | 95.85 | — | — | — | — | — | — | — | — | — | — | — | |
| BioTuneBackbone=ResNet-502026.01 | 95.85 | — | — | — | — | — | — | — | — | 0.3 | — | — | |
| HeteroFLData Partitioning=Non-IID, Dir(0.1)2021.06 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | |
| TSV TABackbone=ViT-B/322025.11 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | |
| MDA TABackbone=ViT-B/322025.11 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | |
| MDA AMBackbone=ViT-B/32, Rotation Alignment=false2025.11 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | |
| DeiT-T# Params=28.9M2025.03 | 95.8 | — | — | — | — | — | — | — | — | — | — | — | |
| MCDArchitecture=ResNet182021.02 | 95.78 | 0.207 | 2.6 | — | — | — | — | — | — | — | — | — | |
| Joint patchingBackbone=ViT-B/162022.08 | 95.7 | — | — | — | — | — | — | — | — | — | — | — | |
| ViT-cls (reproduce)# Params=5.4M2025.03 | 95.7 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=1000, OOD_dataset=Uniform2020.07 | 95.62 | — | — | — | — | — | — | — | — | — | — | — | |
| Baselinelabeled_samples=1000, OOD_dataset=TIN2020.07 | 95.58 | — | — | — | — | — | — | — | — | — | — | — | |
| FTBackbone=ResNet-502026.01 | 95.56 | — | — | — | — | — | — | — | — | — | — | — | |
| ROTBag Size=162024.11 | 95.54 | — | — | — | — | — | — | — | — | — | — | — | |
| DARTS-CDFLOPS(M)=5982021.07 | 95.52 | — | — | 0.195 | — | — | — | — | — | — | — | — |