List your company

Image Classification on ImageNet-C Severity 5 (test)

13.01Mean Error Rate (Severity 5)NOTE
11.350422.552733.75544.9573Jun 3, 2025Aug 7, 2025Oct 11, 2025Dec 16, 2025Feb 19, 2026Apr 25, 2026Jun 30, 2026

Evaluation results

MethodLinks
NOTEBackbone=ResNet26, Venue=NIPS’222025.0613.013.887.6613.60.092.533.1611.9911.6221.5311.2247.892.4816.7914.8725.82———————————
SourceBackbone=ResNet26, Adaptation=None2025.0614.282.063.042.5811.666.8610.7420.7210.5615.3815.9451.782.611.217.7631.36———————————
MEMOBackbone=ResNet26, Venue=NIPS’222025.0615.711.372.111.549.658.2312.4923.0416.0118.4418.6351.253.2915.382430.19———————————
RoTTABackbone=ResNet26, Venue=CVPR’232025.0620.089.4214.2113.899.4711.8316.9730.9113.6623.6130.8156.823.0125.5515.4425.58———————————
TentBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0621.151.672.022.0112.172.142313.748.8613.6917348.443.5154.957.18———————————
CoTTABackbone=ResNet26, Venue=CVPR’222025.0624.0311.4612.7211.219.9711.0416.6830.0326.4726.1735.759.657.8237.2938.4125.76———————————
DMNBackbone=ViT-B-16, Severity Level=52026.0124.1611.514.141422.3215.7824.5622.5431.5230.3635.3454.2416.312.4832.5224.79———————————
SourceBackbone=ViT-B-16, Severity Level=52026.0124.5411.1412.5412.0623.3415.2624.4422.7232.3629.8635.9454.0817.2612.73133.34———————————
MEMOBackbone=ViT-B-16, Severity Level=52026.0124.6311.0812.3812.0223.5415.4424.622.932.5430.0635.9454.0217.4612.831.2433.4———————————
RoTTABackbone=ViT-B-16, Severity Level=52026.0124.7111.4413.0812.3623.4615.4824.6622.7832.629.9235.8654.1817.3412.9231.0233.52———————————
TPTBackbone=ViT-B-16, Severity Level=52026.0124.858.549.4410.1624.0615.062524.0433.9632.1837.0855.5216.5213.6833.933.56———————————
ZEROBackbone=ViT-B-16, Severity Level=52026.0124.910.511.511.1224.7814.8824.3623.2833.0430.437.0654.5216.913.434.932.9———————————
ECALPBackbone=ViT-B-16, Severity Level=52026.0125.1613.3415.5814.122.5615.5625.5223.6430.9630.0235.7852.0818.3413.5233.1433.3———————————
TENTBackbone=ViT-B-16, Severity Level=52026.0125.185.25.687.4225.319.3426.8624.1633.5230.5437.854.3222.5213.935.0836.02———————————
BN AdaptBackbone=ResNet26, Venue=NIPS’202025.0625.1811.5913.4711.4510.8112.820.0732.4127.7628.2138.6358.967.8638.1738.7526.79———————————
SARBackbone=ResNet26, Venue=ICLR’232025.0625.4611.1513.0311.3310.7712.3719.8932.8928.1728.6738.4559.848.5139.2839.9727.61———————————
SANTABackbone=ResNet26, Venue=TMLR’232025.0625.4711.213.311.411.3912.2819.7732.5828.1929.2738.8159.458.0538.4539.9128.06———————————
TentBackbone=ResNet26, Venue=ICLR’212025.0625.5711.7613.412.0511.2412.3519.9832.727.9228.3639.0859.278.0939.0140.0728.33———————————
VTEBackbone=ViT-B-16, Severity Level=52026.0125.619.1810.810.824.714.3624.2825.235.432.4438.255.5216.214.3438.6834.04———————————
ViDABackbone=ResNet26, Venue=ICLR’242025.0626.0311.8813.1311.8910.8712.1919.733.1827.8229.2240.2359.929.5539.4541.2530.15———————————
EATABackbone=ResNet26, Venue=ICML’222025.0626.0710.9113.3211.910.9312.6119.9633.0528.629.1740.4260.579.0339.7141.1529.65———————————
WATTBackbone=ViT-B-16, Severity Level=52026.0126.1811.1812.7813.0225.1218.0826.925.2233.4230.2237.453.9621.8415.1633.4634.94———————————
TDABackbone=ViT-B-16, Severity Level=52026.0126.2212.4214.814.823.716.726.0623.9833.5432.13855.2819.3214.1833.4634.98———————————
DeYOBackbone=ResNet26, Venue=ICLR’242025.0626.4611.4713.211.8610.7112.5519.2933.1128.9729.8142.0159.3910.1539.7841.9332.65———————————
NoAdaptBackbone=All models2025.0929——————————————————————————
MINTBackbone=ViT-B-16, Severity Level=52026.0129.1819.6820.3619.4426.8821.5229.8825.9632.6829.3838.8455.124.319.0636.3838.24———————————
ViTBase-LNBackbone=ViTBase-LN, Scenario=Label Shifts2026.0629.99.426.738.3229.1123.4134.0327.0115.826.347.4154.7243.930.544.547.6———————————
VitBase-LNBackbone=VitBase-LN, Scenario=Batch Size 12026.0629.919.516.78.2128.8823.433.9127.1115.926.4847.254.744.1130.5144.547.81———————————
BATCLIPBackbone=ViT-B-16, Severity Level=52026.0130.0619.4821.0219.325.9221.2629.9628.5235.2231.3840.2455.225.6823.7236.8237.22———————————
ResNet-50-GNBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0630.618.0119.7817.9119.811.4121.3924.940.4147.2933.669.3136.3118.5928.4152.29———————————
ResNet-50-GNBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0630.617.919.917.919.711.321.324.940.447.433.669.236.318.728.452.2———————————
TentBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0630.6528.8535.9533.4916.677.1927.3530.1417.9725.22.2771.8846.247.3652.7256.4———————————
No Adapt.Severity Level=5, Imbalance Ratio=∞, Scenario=Online imbalanced label shifts2026.0631.516.711.916.329.323.633.927.315.926.547.254.944.130.94548.9———————————
No Adapt.Batch Size=1, Severity=52026.0631.616.81216.529.223.63427.315.826.647.555.444.33145.149.1———————————
No Adapt.scenario=mild2026.0631.616.81216.529.223.63427.315.826.647.555.444.33145.149.1———————————
SubTTABackbone=ViT-B-16, Severity Level=52026.0132.1521.1622.8821.4425.3424.8230.729.6437.2435.941.2656.9629.7429.437.5838.18———————————
T3ABackbone=ViT-B/16, Adaptation=Online TTA2025.1232.216.611.816.429.924.334.528.515.92749.156.144.833.345.149.4———————————
LinearTCABatch Size=1, Severity=52026.0632.817.91317.429.824.235.728.81727.849.85645.8334649.8———————————
LinearTCAscenario=mild2026.0632.817.91317.429.824.235.728.81727.849.85645.8334649.8———————————
LinearTCASeverity Level=5, Imbalance Ratio=∞, Adaptation Protocol=Online TTA2026.0632.9181317.430.124.4362917.2285055.645.933.146.249.8———————————
TentBackbone=All models2025.0933.5——————————————————————————
SARBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0635.8228.5130.9129.2718.515.3428.830.5344.4744.2732.9472.0344.6713.1647.756.23———————————
CLIPBackbone=ResNet26, Venue=ICML’252025.0635.8922.9423.224.0631.519.835.8433.584539.3447.2662.8834.5425.7450.6842.02———————————
SARBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0635.8928.7131.1929.3918.5215.128.7129.8442.8644.3335.3272.0744.6514.447.0456.22———————————
SARBackbone=All models2025.0938——————————————————————————
no_adaptbatch size=12025.1238.8834.9333.6736.4132.3822.2236.6131.122.1526.7353.1661.1750.2731.9654.5255.87———————————
no_adaptBackbone=ViT-B/16, Scenario=Mild Scenario, Corruption Severity=52025.1238.8834.9333.6736.4132.3822.2236.6131.122.1526.7353.1661.1750.2731.9654.5255.87———————————
NOTEbatch size=12025.1238.9535.2533.5636.1332.5322.4236.8230.9122.4727.0853.4361.4150.1531.8754.3955.83———————————
DDABackbone=ViT-B/16, Adaptation=Online TTA2025.1239.152.55452.133.840.633.330.229.735548.62.7506058.8———————————
NOTEBackbone=ViT-B/16, Scenario=Mild Scenario, Corruption Severity=52025.1239.1535.1133.8636.5832.7122.3936.9231.322.3326.953.1462.2551.1832.0454.6455.95———————————
MEMObatch size=12025.1239.9737.3135.1939.0432.1322.5738.4431.8123.7828.8752.9162.2752.331.9654.7756.27———————————
DeYOBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0641.6540.2743.5841.7522.4222.6940.9314.6353.1951.781.0372.8952.9347.8159.4859.3———————————
NaiveBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0641.7441.3744.2442.4322.5223.2140.9512.4652.4951.831.3973.352.9147.8159.5359.59———————————
KLBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0642.2642.4944.8743.5622.9223.740.7617.5953.0752.031.8773.3852.9346.2859.1859.28———————————
SVGDBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0642.4942.4344.8243.6622.9823.5440.7417.5553.1151.974.3173.5152.9746.8259.3859.58———————————
COMEBackbone=All models2025.0943——————————————————————————
GradBackbone=ResNet-50-GN, Scenario=Label Shifts2026.0643.2742.4244.843.6422.9523.5940.7917.5353.0951.9715.7973.55346.9259.4159.61———————————
DEYOBackbone=All models2025.0943.5——————————————————————————
CoDiReBackbone=ResNet262025.0643.9727.3629.5530.135.5925.7742.1343.9752.1748.1757.7372.3839.7141.9560.5752.39———————————
CoTTABackbone=ViT-B/16, Adaptation=Online TTA2025.1244.440.331.839.635.533.146.937.32.946.459.171.755.546.459.459———————————
DeYOBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0644.441.9744.2143.0321.8123.2840.8726.153.2451.2235.1372.3952.542.4459.158.73———————————
FOAAccess=Gray-box, Model=ViT-B/16, Severity=52026.0444.95758.557.851.73537.127.220.211.972.276.80.639.166.767——————-10.6————
NaiveBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0645.0142.5444.9543.6122.4723.974130.953.751.6627.9373.3752.8947.0159.6659.53———————————
SVGDBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0645.1142.5744.943.7922.7224.240.8932.0453.451.6928.4173.345346.3959.6459.62———————————
MEMOBackbone=ViT-B/16, Scenario=Mild Scenario, Corruption Severity=52025.1245.3843.7843.2545.8332.928.4645.6738.2530.0834.6354.869.9956.4334.4762.5659.61———————————
SARbatch size=12025.1245.5140.3239.7942.7738.7327.7345.1336.8530.8636.0458.0668.4356.4737.1663.3460.95———————————
KLBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0645.5842.544.7443.722.524.0640.7735.0553.6751.832.4473.3352.9747.0259.5559.58———————————
GradBackbone=ResNet-50-GN, Scenario=Batch Size 12026.0646.942.7344.9943.8822.4924.3241.0725.6354.152.0358.8873.3353.2847.6959.4159.7———————————
EATABatch Size=1, Severity=52026.0647.236.430.735.444.74046.441.838.539.161.865.961.647.159.759.7———————————
EATABackbone=All models2025.0947.5——————————————————————————
DeYOBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0347.73——————————————————————————
AcTTAETABackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0348.9——————————————————————————
Tentbatch size=12025.1249.1947.1546.447.5145.1934.0147.5739.5237.2940.0358.9769.4360.6139.8862.7661.49———————————
AcTTADeYOBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0349.64——————————————————————————
ETABackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0349.84——————————————————————————
AcTTAROIDBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0349.89——————————————————————————
ZeroSiamBackbone=All models2025.0950.1——————————————————————————
EATASeverity Level=5, Imbalance Ratio=∞, Adaptation Protocol=Online TTA2026.0650.139.337.638.944.145.244.446.854.754.16072.525.95866.364———————————
AcTTACMFBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0350.44——————————————————————————
CMFBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0350.85——————————————————————————
SourceBackbone=ViT-B/16, Adaptation=None2025.125146.947.646.942.734.250.544.756.952.656.576.131.846.765.566———————————
TentBatch Size=1, Severity=52026.065144.742.945.452.548.155.550.615.618.666.675.164.952.967.164.6———————————
Tentscenario=mild2026.0651.244.642.845.252.147.855.350.318.121.266.47564.852.766.964.4———————————
TentBackbone=VitBase-LN, Scenario=Batch Size 12026.0651.5851.1551.7852.552.1847.6856.2849.068.7815.9267.2573.4566.6452.0964.9363.98———————————
AcTTATENTBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0351.79——————————————————————————
TentBackbone=ViT-B/16, Scenario=Mild Scenario, Corruption Severity=52025.1251.8751.9352.7753.0552.5945.5354.8948.0717.3319.7966.3473.1965.0646.4466.5764.53———————————
TentSeverity Level=5, Imbalance Ratio=∞, Adaptation Protocol=Online TTA2026.0652.346.446.846.154.652.258.25310.210.569.676.266.158.169.466.7———————————
ROIDBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0352.91——————————————————————————
EATAbatch size=12025.1252.9948.5648.1749.6248.1739.151.3444.3745.014664.8472.5961.4547.6563.9764.03———————————
TentBackbone=ViTBase-LN, Scenario=Label Shifts2026.0653.153.4153.1654.3654.3452.4658.7452.834.297.0469.4674.9267.4259.9767.8966.13———————————
ROID + DO-ALLBackbone=ResNet-50, Severity=5, Adaptation=Online (DO-ALL)2026.0653.668.960.560.569.265.856.648.451.556.942.332.858.944.64145.4———————————
Tent + MixTTASeverity Level=5, Imbalance Ratio=∞, Adaptation Protocol=Online TTA2026.0653.637.83429.454.253.659.655.145.52170.976.566.760.17168.1———————————
TENTBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0353.85——————————————————————————
SARBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0353.9——————————————————————————
EATA + MixTTASeverity Level=5, Imbalance Ratio=∞, Adaptation Protocol=Online TTA2026.0653.947.946.248.950.352.631.654.262.960.658.77619.162.67166.1———————————
SARBackbone=ViT-B/16, Scenario=Mild Scenario, Corruption Severity=52025.1253.9751.9352.953.0652.6647.0854.8848.4226.634.8766.2872.7964.6750.866.464.36———————————
LAMEAccess=Black-box, Model=ViT-B/16, Severity=52026.0454.156.556.557.246.434.752.744.258.461.563.177.424.744.666.667.2——————-1.4————
AcTTASARBackbone=ViT-B/16, Normalization=LN, Severity Level=52026.0354.17——————————————————————————
ZOO-CMAAccess=Black-box, Model=ViT-B/16, Severity=52026.0454.558.259.660.350.838.655.245.758.559.659.776.74.149.871.270——————-1————
ROIDBackbone=ResNet-50, Severity=5, Adaptation=Online2026.0654.571.762.262.269.666.557.149.352.357.443.533.459.145.441.846.2———————————