Image Classification on CIFAR10 (Accuracy, Uncertainty)
99.13AccuracyMango
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MangoTraining mode=Training from the Pretrained Model: M(12,384) → M(12,768), FLOPs (x 1e18)=3.0, Ratio (Saving)=76.4%2023.10 | 99.13 | — | |
| StackBERTTraining mode=Training from Scratch, FLOPs (x 1e18)=11.3, Ratio (Saving)=12.6%2023.10 | 99.11 | — | |
| LIGOTraining mode=Training from the Pretrained Model: M(12,384) → M(12,768), FLOPs (x 1e18)=5.7, Ratio (Saving)=55.7%2023.10 | 99.11 | — | |
| ScratchTraining mode=Training from Scratch, FLOPs (x 1e18)=12.92023.10 | 99.03 | — | |
| bert2BERTTraining mode=Training from the Pretrained Model: M(12,384) → M(12,768), FLOPs (x 1e18)=4.6, Ratio (Saving)=64.4%2023.10 | 98.99 | — | |
| StandardBackbone=ViT-L/142025.11 | 98.02 | — | |
| FCBMBackbone=ViT-L/14, Average NEC=28.082025.11 | 97.21 | — | |
| LF-CBMBackbone=ViT-L/14, Average NEC=27.852025.11 | 97.18 | — | |
| Standard (sparse)Backbone=ViT-L/14, Average NEC=28.922025.11 | 96.61 | — | |
| PC-DARTS-CDFLOPS(M)=5572021.07 | 96.47 | 0.463 | |
| CF-CBMBackbone=ViT-L/14, Average NEC=28.562025.11 | 96.35 | — | |
| µDARTSFLOPS(M)=6022021.07 | 96.22 | 0.162 | |
| Linear Probing2024.04 | 96.12 | — | |
| ASAP-CDFLOPS(M)=5732021.07 | 95.72 | 0.481 | |
| TeacherTeacher Architecture=ResNet-34, Student Architecture=ResNet-182023.09 | 95.7 | — | |
| SpaceshipNetTeacher Architecture=ResNet-34, Student Architecture=ResNet-182023.09 | 95.39 | — | |
| P-DARTS-CDFLOPS(M)=5322021.07 | 95.32 | 0.496 | |
| NAYERTeacher Architecture=ResNet-34, Student Architecture=ResNet-18, E=3002023.09 | 95.21 | — | |
| GOLD-NAS-A-CDFLOPS(M)=2782021.07 | 95.06 | 0.412 | |
| no-stitchstitching_type=none, decoder=SVM (linear kernel)2023.11 | 95 | — | |
| RDARTS-CDFLOPS(M)=6052021.07 | 94.89 | 0.396 | |
| RényiCLEvaluation Protocol=linear evaluation, Multi-crop Augmentation=true2022.08 | 94.4 | — | |
| DARTSFLOPS(M)=5952021.07 | 94.32 | — | |
| DARTS-CDFLOPS(M)=5982021.07 | 94.29 | 0.474 | |
| CLSAEvaluation Protocol=linear evaluation, Multi-crop Augmentation=false2022.08 | 94.2 | — | |
| CLSAEvaluation Protocol=linear evaluation, Multi-crop Augmentation=true2022.08 | 93.9 | — | |
| RényiCLEvaluation Protocol=linear evaluation, Multi-crop Augmentation=false2022.08 | 93.8 | — | |
| DeepInvTeacher Architecture=ResNet-34, Student Architecture=ResNet-182023.09 | 93.26 | — | |
| GOLD-NAS-I-CDFLOPS(M)=4632021.07 | 93.21 | 0.519 | |
| SMPConvParams.=490k2023.04 | 93 | — | |
| orthostitching_type=latent translation (ortho), zero_shot=true, decoder=SVM (linear kernel)2023.11 | 93 | — | |
| ResNet-44Params.=660k2023.04 | 92.9 | — | |
| InfoMinEvaluation Protocol=linear evaluation, Multi-crop Augmentation=false2022.08 | 92.8 | — | |
| CMITeacher Architecture=WideResNet-40-2, Student Architecture=WideResNet-16-22023.09 | 92.52 | — | |
| FlexNet-16Params.=670k2023.04 | 92.2 | — | |
| PCBMBackbone=ViT-L/14, Average NEC=32.562025.11 | 92.13 | — | |
| affinestitching_type=latent translation (affine), zero_shot=true, decoder=SVM (linear kernel)2023.11 | 92 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=50, τ=02023.06 | 91.31 | — | |
| Sparse-CBM2024.04 | 91.17 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=50, τ=0.12023.06 | 91.17 | — | |
| BaselineBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=02023.06 | 90.87 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=80, τ=0.12023.06 | 90.63 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=80, τ=02023.06 | 90.54 | — | |
| 1-orthostitching_type=latent translation (1-ortho), zero_shot=true, decoder=SVM (linear kernel)2023.11 | 90 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=50, τ=0.52023.06 | 89.99 | — | |
| VanillaBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=502023.06 | 89.95 | — | |
| SVD pruneBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=502023.06 | 89.81 | — | |
| Cayley SGDBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=02023.06 | 89.65 | — | |
| EfficientNet-B0FLOPS(M)=3902021.07 | 89.01 | 1.059 | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=80, τ=0.52023.06 | 88.84 | — | |
| MobileNetv2FLOPS(M)=5692021.07 | 88.79 | 0.915 | |
| StandardBackbone=ResNet502025.11 | 88.55 | — | |
| SVD pruneBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=802023.06 | 88.45 | — | |
| VanillaBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=802023.06 | 88.06 | — | |
| linearstitching_type=latent translation (linear), zero_shot=true, decoder=SVM (linear kernel)2023.11 | 88 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=50, τ=mean2023.06 | 87.93 | — | |
| LaBosupervision=full-supervised2024.04 | 87.9 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=80, τ=mean2023.06 | 86.98 | — | |
| ResNet20FLOPS(M)=3202021.07 | 86.47 | 0.895 | |
| Label-Free CBM2024.04 | 86.4 | — | |
| LF-CBMBackbone=ResNet50, Average NEC=27.372025.11 | 86.16 | — | |
| Projected SGDBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=02023.06 | 85.84 | — | |
| FCBMBackbone=ResNet50, Average NEC=28.852025.11 | 85.59 | — | |
| CF-CBMBackbone=ResNet50, Average NEC=28.462025.11 | 85.42 | — | |
| l1-CBM2024.04 | 85.11 | — | |
| Concept Matrix Search2024.04 | 85.03 | — | |
| Contrastive-CBM2024.04 | 84.75 | — | |
| DLRTBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=802023.06 | 84.38 | — | |
| VGG16FLOPS(M)=1602021.07 | 84.11 | 1.034 | |
| ALIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 83.8 | — | |
| DLRTBackbone=VGG16, Rel. perturbation ε=0, c.r. (%)=502023.06 | 83.67 | — | |
| Post-hoc CBMbase_model=CLIP2024.04 | 83.34 | — | |
| Standard (sparse)Backbone=ResNet50, Average NEC=29.842025.11 | 82.11 | — | |
| Zero-Shot2024.04 | 81.79 | — | |
| DescriptionCLS2024.04 | 81.61 | — | |
| relativestitching_type=relative, decoder=SVM (linear kernel)2023.11 | 80 | — | |
| PCBMBackbone=ResNet50, Average NEC=32.372025.11 | 76.43 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=50, τ=0.12023.06 | 75.39 | — | |
| BaselineBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=02023.06 | 75.15 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=80, τ=02023.06 | 74.76 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=50, τ=02023.06 | 74.57 | — | |
| Cayley SGDBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=02023.06 | 74.35 | — | |
| HiCLIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 74.1 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=50, τ=0.52023.06 | 72.62 | — | |
| CKCNN-16Params.=630k2023.04 | 72.1 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=80, τ=0.12023.06 | 70.79 | — | |
| DeFILIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 70.1 | — | |
| Projected SGDBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=02023.06 | 69.67 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=80, τ=0.52023.06 | 69.36 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=50, τ=mean2023.06 | 68.46 | — | |
| VanillaBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=502023.06 | 68.01 | — | |
| SVD pruneBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=502023.06 | 67.5 | — | |
| DeCLIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 66.7 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=80, τ=mean2023.06 | 66.27 | — | |
| FILIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 65.5 | — | |
| VanillaBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=802023.06 | 65.4 | — | |
| HiDeCLIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 65.1 | — | |
| CLIP-ViT-B/32Pre-training Dataset=YFCC15M, Backbone=ViT-B/32, Evaluation Protocol=zero-shot2023.08 | 63.7 | — | |
| SVD pruneBackbone=VGG16, Rel. perturbation ε=0.002, c.r. (%)=802023.06 | 63.55 | — | |
| CondLRBackbone=VGG16, Rel. perturbation ε=0.004, c.r. (%)=50, τ=0.12023.06 | 62.01 | — |