List your company

Image Classification on ImageNet Robustness Suite

93.96Top-1 Accuracy (ImageNet-A)SAM
-0.638423.920848.4873.0392Sep 15, 2022May 2, 2023Dec 18, 2023Aug 3, 2024Mar 21, 2025Nov 5, 2025Jun 23, 2026

Evaluation results

MethodLinks
SAM#Epochs=100, Runtime=41h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0693.96———81.8673.42—————87.6155.5642.5388.2369.5385.54———
Dropout#Epochs=100, Runtime=20.6h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0693.44———88.0679.3—————93.4765.8750.3791.1579.6287.19———
Dropout#Epochs=200, Runtime=41.1h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0693.33———87.9979.63—————90.9566.951.2392.5681.2487.6———
ASAM#Epochs=100, Runtime=41.1h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0692.99———81.4772.55—————85.8555.1340.7489.0367.884.31———
DAMP#Epochs=100, Runtime=20.7h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0692.92———83.1674.76—————92.7657.8544.7888.7969.9285.65———
DAMP#Epochs=200, Runtime=41.1h, Backbone=ViT-S16, Data Augmentation=Basic Inception-style2024.0690.56———81.8272.15—————84.3355.5841.0687.8768.3684.18———
TuringViT-24LResolution=dyn., Pretraining data=0.85B, Evaluation Protocol=Zero-shot2026.0689.783.97895.373.683.6—————————————81.1
TuringViT-18LResolution=dyn., Pretraining data=0.85B, Evaluation Protocol=Zero-shot2026.0687.983.177.69572.882.7—————————————79.7
VanillaModel=DINOv3, r=4, GFLOPs=13492026.0486.53——92.1671.583.4——————65.36———————
EVAFine-tuning Protocol=without specialized fine-tuning2022.1186.289.681.690.867.784—88.35.6———————————
CATISModel=DINOv3, r=4, GFLOPs=815.82026.0486.15——91.6771.1182.98——————59.94———————
Seed1.5-ViTResolution=dyn., Pretraining data=4.8B, Evaluation Protocol=Zero-shot2026.0685.583.677.695.274.182.5—————————————79.2
Eff-L2-NSFine-tuning Protocol=without specialized fine-tuning2022.1184.888.480.590.647.677.8—74.710.6———————————
SigLIP2-LResolution=384, Pretraining data=10B, Evaluation Protocol=Zero-shot2026.0684.383.177.495.775.583.4—————————————84.4
ToFuModel=DINOv3, r=4, GFLOPs=815.82026.0483.91——90.3770.4481.57——————54.32———————
ToMeModel=DINOv3, r=4, GFLOPs=815.82026.0483.76——91.4170.7181.96——————59.8———————
MCTFModel=DINOv3, r=4, GFLOPs=815.82026.0483.44——91.5271.0582——————59.81———————
PiToMeModel=DINOv3, r=4, GFLOPs=814.12026.0483.41——91.2470.8381.83——————56.92———————
BEiTFine-tuning Protocol=without specialized fine-tuning2022.1181.788.679.990.756.878.5—73.210.1———————————
DeiT3Fine-tuning Protocol=without specialized fine-tuning2022.1179.287.779.190.254.977—70.610.7———————————
MAEFine-tuning Protocol=without specialized fine-tuning2022.1176.787.879.290.350.975.2—66.512.6———————————
BEiTv2Fine-tuning Protocol=without specialized fine-tuning2022.1176.288.480.190.358.378.3—76.410.1———————————
Swin V2Fine-tuning Protocol=without specialized fine-tuning2022.1173.987.577.390.252.374.8—67.712.7———————————
ConvNextFine-tuning Protocol=without specialized fine-tuning2022.1170.887.577.790.553.774.5—6713———————————
MobileCLIP2-LResolution=224, Pretraining data=1.9B, Evaluation Protocol=Zero-shot2026.066981.974.791.769.877—————————————75.3
TDABackbone=ViT-L/142024.1061.2776.2868.4288.41—71.8170.69———64.67—————————
DPEBackbone=ViT-L/142024.1061.0977.8770.8389.18—73.0671.86———66.33—————————
TPTBackbone=ViT-B/162022.0954.4768.9663.4677.147.9362.3860.74—————————————
OpenCLIPBackbone=ViT-L/142024.1053.8874.0467.6987.42—69.3168.13———63.18—————————
CoCoOpBackbone=ViT-B/162022.0950.7670.763.9376.0948.662.0259.85—————————————
CoOpBackbone=ViT-B/162022.0949.9971.7164.4975.5148.161.9659.52—————————————
CLIPBackbone=ViT-B/162022.0947.8766.7360.8673.9846.0959.1157.2—————————————
VanillaModel=DeiT-3-L, r=11, GFLOPs=61.62026.0445.13——57.3944.1948.9——————41.55———————
CATISModel=ViT-L, r=11, GFLOPs=22.82026.0443.65——59.7645.1249.51——————33.77———————
VanillaModel=ViT-L, r=11, GFLOPs=61.62026.0443.27——60.8945.5549.9——————41.91———————
Dropout#Epochs=500, Runtime=111h, Backbone=ViT-S16, Data Augmentation=MixUp and RandAugment2024.0640.85———71.0362.38—————62.4584.2934.3586.5956.3180.87———
SAM#Epochs=300, Runtime=123h, Backbone=ViT-S16, Data Augmentation=MixUp and RandAugment2024.0640.05———70.8561.66—————59.9283.9134.3485.9955.6380.18———
ASAM#Epochs=300, Runtime=123h, Backbone=ViT-S16, Data Augmentation=MixUp and RandAugment2024.0639.44———69.1361.02—————59.3883.6433.8285.4154.4380.5———
DAMP#Epochs=500, Runtime=111h, Backbone=ViT-S16, Data Augmentation=MixUp and RandAugment2024.0639.3———68.0360.72—————59.8783.1234.0184.7454.1680.05———
Dropout#Epochs=275, Runtime=123h, Backbone=ViT-B16, Data Augmentation=MixUp and RandAugment2024.0639.14———71.3661.08—————56.4382.8533.1387.7256.1579.13———
SAM#Epochs=150, Runtime=135h, Backbone=ViT-B16, Data Augmentation=MixUp and RandAugment2024.0639.09———71.2261.61—————61.8582.6932.9588.3855.3379.48———
DAMP#Epochs=275, Runtime=124h, Backbone=ViT-B16, Data Augmentation=MixUp and RandAugment2024.0637.77———67.9159.19—————55.280.4931.6387.0652.3278.69———
ASAM#Epochs=150, Runtime=136h, Backbone=ViT-B16, Data Augmentation=MixUp and RandAugment2024.0637.41———69.5459.85—————58.8782.2130.7688.0351.8478.83———
TPGM-CBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Controlled Projected Gradient Method, Number of Classes=Full ImageNet2023.0336.7982.4173.9162.4854.9178.1651.39—-1.8626.51——————————
VanillaModel=DeiT-3-B, r=23, GFLOPs=17.62026.0436.75——36.854.0742.54——————41.05———————
WISEBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Weight Ensemble, Number of Classes=Full ImageNet2023.0336.1182.1173.6161.7754.1677.8650.68—-2.2324.75——————————
TPGMBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Trainable Projected Gradient Method, Number of Classes=Full ImageNet2023.0334.2984.1975.4157.1954.3879.848.62—0.219.69——————————
Zero-ShotBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Zero-Shot, Number of Classes=Full ImageNet2023.0330.667.6861.4156.7745.5364.5444.3—-18.918.64——————————
BitFitBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Parameter-Efficient Fine-tuning, Number of Classes=Full ImageNet2023.0327.1978.0267.6950.6646.572.8541.45—-8.422.45——————————
LPBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Linear Probing, Number of Classes=Full ImageNet2023.0327.1377.9967.7450.7146.4772.8641.44—-8.512——————————
TPTBackbone=RN502022.0926.660.7754.759.0835.1747.2743.89—————————————
Vanilla FTBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Fine-tuning, Number of Classes=Full ImageNet2023.0326.5284.275.0846.4548.979.6440.63—00——————————
L2-SPBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Fine-tuning, Number of Classes=Full ImageNet2023.0326.1984.175.0546.5848.5179.5840.43—-0.08-0.49——————————
CATISModel=DeiT-3-L, r=11, GFLOPs=22.82026.0426.11——42.6435.1234.62——————29.36———————
LP-FTBackbone=ViT-B, Pre-trained=CLIP, Evaluation Protocol=Linear Probing then Fine-tuning, Number of Classes=Full ImageNet2023.0325.6283.573.9546.2148.8378.7340.22—-1.15-1——————————
CATISModel=DeiT-3-B, r=23, GFLOPs=6.32026.0425.44——43.9633.4434.28——————26.21———————
PiToMeModel=DeiT-3-L, r=11, GFLOPs=22.82026.0423.64——35.0325.9628.21——————16.38———————
CoCoOpBackbone=RN502022.0923.3862.8655.5957.5534.7446.8242.82—————————————
VanillaModel=DeiT-3-S, r=23, GFLOPs=4.62026.0423.27——46.5435.4235.08——————29.06———————
CoOpBackbone=RN502022.0923.2363.2755.557.0834.6846.7542.62—————————————
CLIPBackbone=RN502022.0921.8358.1651.4156.1533.3744.1840.69—————————————
PiToMeModel=ViT-L, r=11, GFLOPs=22.82026.0421.72——39.2629.9230.3——————18.1———————
VanillaModel=ViT-B, r=13, GFLOPs=17.62026.0421.21——41.2416.5926.35——————25.03———————
CATISModel=ViT-B, r=13, GFLOPs=10.42026.0420.93——41.0416.8926.29——————23.51———————
ToFuModel=ViT-B, r=13, GFLOPs=10.42026.0420.76——39.0116.4125.39——————21.73———————
ToMeModel=ViT-B, r=13, GFLOPs=10.42026.0419.55——40.9516.8525.78——————23.13———————
MCTFModel=ViT-B, r=13, GFLOPs=10.42026.0418.97——40.516.1725.21——————21.84———————
PiToMeModel=ViT-B, r=13, GFLOPs=10.42026.0418.92——38.5516.624.69——————20.17———————
PiToMeModel=DeiT-3-B, r=23, GFLOPs=6.32026.0417.53——29.1320.7422.47——————13.92———————
VanillaModel=ViT-S, r=13, GFLOPs=4.62026.0414.35——35.0714.7121.38——————20.27———————
CATISModel=ViT-S, r=13, GFLOPs=2.72026.0413.93——34.2714.7420.98——————18.9———————
ToFuModel=ViT-S, r=13, GFLOPs=2.72026.0413.48——31.6813.9719.71——————16.84———————
ToMeModel=ViT-S, r=13, GFLOPs=2.72026.0412.97——34.3314.6720.66——————18.89———————
MCTFModel=ViT-S, r=13, GFLOPs=2.72026.0412.44——33.4213.4619.77——————17.78———————
PiToMeModel=ViT-S, r=13, GFLOPs=2.72026.0412.28——30.8414.1319.08——————15.4———————
MCTFModel=DeiT-3-L, r=11, GFLOPs=22.82026.0410.69——33.1328.8724.23——————20.3———————
CATISModel=DeiT-3-S, r=23, GFLOPs=1.72026.0410.04——25.2620.1218.47——————12.38———————
ToMeModel=DeiT-3-L, r=11, GFLOPs=22.82026.049.93——31.3327.8723.04——————19.51———————
MCTFModel=DeiT-3-B, r=23, GFLOPs=6.32026.049.89——31.4125.6222.31——————17.75———————
ToMeModel=DeiT-3-B, r=23, GFLOPs=6.32026.048.89——30.5724.9321.46——————17.43———————
PiToMeModel=DeiT-3-S, r=23, GFLOPs=1.72026.048.52——18.2212.613.11——————6.34———————
ToFuModel=DeiT-3-B, r=23, GFLOPs=6.32026.047.65——22.1517.0115.6——————11.57———————
ToFuModel=DeiT-3-L, r=11, GFLOPs=22.82026.047.07——12.3911.6310.36——————8.24———————
ToMeModel=ViT-L, r=11, GFLOPs=22.82026.046.57——24.8619.2516.89——————15.19———————
MCTFModel=ViT-L, r=11, GFLOPs=22.82026.046——25.2620.1517.14——————14.54———————
MCTFModel=DeiT-3-S, r=23, GFLOPs=1.72026.044.8——16.4913.7211.67——————8.94———————
ToMeModel=DeiT-3-S, r=23, GFLOPs=1.72026.044.07——16.9914.611.89——————8.26———————
ToFuModel=DeiT-3-S, r=23, GFLOPs=1.72026.043.49——11.117.927.51——————4.63———————
ToFuModel=ViT-L, r=11, GFLOPs=22.82026.043——10.957.447.13——————2.66———————
CLIPBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K2026.03—63.35————57.44——————————8.8220.46—
CLIPBackbone=ViT-B/162026.03——————63.76——————————13.15——
FAREBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K, Adversarial Defense Type=Adversarial Fine-tuning2026.03—47.38————41.56——————————13.4325.07—
FAREBackbone=ViT-B/162026.03——————53.92——————————17.54——
FLYPBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K, Adversarial Defense Type=Robust Fine-tuning2026.03—72.15————55.32——————————8.4920.03—
FLYPBackbone=ViT-B/162026.03——————67.29——————————12.71——
GRACEBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K2026.03—74.21————57.01——————————22.4439.69—
GRACEBackbone=ViT-B/162026.03——————67.29——————————33.44——
LAATBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K, Adversarial Defense Type=Adversarial Fine-tuning2026.03—55.46————41.95——————————17.930.69—
LAATBackbone=ViT-B/162026.03——————50.31——————————26.25——
PMG-AFTBackbone=ViT-B/32, Fine-tuning Dataset=ImageNet-1K, Adversarial Defense Type=Adversarial Fine-tuning2026.03—58.2————43.4——————————19.5732.85—