List your company
ResearchFormerly WizWand

Image Classification on CIFAR-10 ViT-Tiny (test)

74.49AccuracyLoRITa
7.30624.74842.1959.632Nov 6, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.1174.49
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=100%2025.1172.73
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=100%2025.1171.42
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.1169.9
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.1169.82
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.1169.62
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.1168.89
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.1168.68
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.1168.43
Vanilla ViT-TParameter Retention p=100%2025.1168.4
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.1168.33
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.1168.01
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.1167.71
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.1167.49
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.1167.44
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=40%2025.1167.4
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.1167.37
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.1167.07
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.1166.89
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.1166.54
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.1165.55
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.1165.5
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.1165.26
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.1165.11
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.1164.96
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.1164.55
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.1164.49
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=30%2025.1163.68
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.1162.95
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.1162.53
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.1162.15
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.1161.75
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.1161.58
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.1161.23
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.1161.15
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.1159.73
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.1158.83
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.1156.06
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=20%2025.1150.35
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.1147.58
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.1147.37
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.1145.6
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=40%2025.1145.23
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=15%2025.1144.66
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.1143.87
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.1143.35
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.1140.85
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.1138.96
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=10%2025.1138.61
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.1138.39
LoRAParameter Retention p=15%2025.1136.55
LoRAParameter Retention p=20%2025.1135.76
LoRAParameter Retention p=10%2025.1135.46
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=30%2025.1132.47
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.1123.22
LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=5%2025.1122.58
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.1121.36
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=20%2025.1121.25
Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.1120.41
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.1119.98
Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.1118.7
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.1117.96
Vanilla ViT-TParameter Retention p=30%2025.1116.24
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=15%2025.1115.43
Vanilla ViT-TParameter Retention p=40%2025.1115.24
Vanilla ViT-TParameter Retention p=5%2025.1114.75
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=10%2025.1114.33
Vanilla ViT-TParameter Retention p=15%2025.1113.5
LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.1113.38
Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.1113.13
Vanilla ViT-TParameter Retention p=10%2025.1112.52
Vanilla ViT-TParameter Retention p=20%2025.1112.13
LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=5%2025.119.89