List your company

Online Test-Time Adaptation on 11 VLM Downstream Datasets (test)

69.5Average AccuracyStatA
64.365.656768.35Jan 7, 2025

Evaluation results

MethodLinks
StatABatch Size=128, Scenario=High (γ = 0.001)2025.0169.571.96627.951.874.789.394.876.494.44769.8
StatABatch Size=128, Scenario=Separate2025.0169.171.764.928.948.275.288.995.277.694.345.869
StatABatch Size=128, Scenario=Medium (γ = 0.01)2025.0168.969.665.927.352.373.289.194.675.694.346.869.7
TDABatch Size=128, Scenario=Low (γ = 0.1)2025.0167.768.36625.460.666.986.189.672.593.445.571
DMNBatch Size=128, Scenario=Low (γ = 0.1)2025.0167.26864.824.959.86784.289.973.392.244.870.3
TDABatch Size=128, Scenario=Medium (γ = 0.01)2025.0167.168.265.625.256.566.585.889.372.693.545.270.1
StatABatch Size=128, Scenario=Low (γ = 0.1)2025.016766.263.624.352.367.48892.572.794.246.868.8
TDABatch Size=128, Scenario=High (γ = 0.001)2025.0166.867.965.125.155.366.385.58972.593.645.169.7
MTABatch Size=128, Scenario=Baseline2025.0166.669.364.827.446.96887.289.471.79444.469
TDABatch Size=128, Scenario=Separate2025.0166.667.464.624.955.365.985.288.972.393.64569.6
DMNBatch Size=128, Scenario=Medium (γ = 0.01)2025.0166.56864.824.956.266.881.9897392.144.969.6
DMNBatch Size=128, Scenario=High (γ = 0.001)2025.0166.367.964.824.956.366.879.988.972.992.144.869.4
TENTBatch Size=128, Scenario=Low (γ = 0.1)2025.0165.866.664.524.651.865.785.989.370.693.44467.8
DMNBatch Size=128, Scenario=Separate2025.0165.867.764.724.955.166.778.58872.891.944.869
TENTBatch Size=128, Scenario=Medium (γ = 0.01)2025.0165.566.764.324.647.965.685.989.470.693.34467.8
TENTBatch Size=128, Scenario=High (γ = 0.001)2025.0165.366.864.324.845.665.686.189.470.593.44467.9
CLIPBatch Size=128, Scenario=Baseline2025.0165.266.662.524.748.365.685.989.170.793.243.567.5
TENTBatch Size=128, Scenario=Separate2025.0164.566.764.224.73765.686.189.370.893.443.967.9