Image Classification on CIFAR-10 ViT-Tiny (test)
74.49AccuracyLoRITa
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.11 | 74.49 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=100%2025.11 | 72.73 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=100%2025.11 | 71.42 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.11 | 69.9 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.11 | 69.82 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.11 | 69.62 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=100%2025.11 | 68.89 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.11 | 68.68 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.11 | 68.43 | |
| Vanilla ViT-TParameter Retention p=100%2025.11 | 68.4 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.11 | 68.33 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.11 | 68.01 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=40%2025.11 | 67.71 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.11 | 67.49 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.11 | 67.44 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=40%2025.11 | 67.4 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=100%2025.11 | 67.37 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.11 | 67.07 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=30%2025.11 | 66.89 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.11 | 66.54 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.11 | 65.55 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.11 | 65.5 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.11 | 65.26 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.11 | 65.11 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.11 | 64.96 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.11 | 64.55 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=20%2025.11 | 64.49 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=30%2025.11 | 63.68 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.11 | 62.95 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=40%2025.11 | 62.53 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.11 | 62.15 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.11 | 61.75 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.11 | 61.58 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.11 | 61.23 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=15%2025.11 | 61.15 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=30%2025.11 | 59.73 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.11 | 58.83 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.11 | 56.06 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=20%2025.11 | 50.35 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.11 | 47.58 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.11 | 47.37 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=20%2025.11 | 45.6 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=40%2025.11 | 45.23 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=15%2025.11 | 44.66 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.11 | 43.87 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.11 | 43.35 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.11 | 40.85 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=10%2025.11 | 38.96 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=10%2025.11 | 38.61 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=15%2025.11 | 38.39 | |
| LoRAParameter Retention p=15%2025.11 | 36.55 | |
| LoRAParameter Retention p=20%2025.11 | 35.76 | |
| LoRAParameter Retention p=10%2025.11 | 35.46 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=30%2025.11 | 32.47 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.11 | 23.22 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-1, Parameter Retention p=5%2025.11 | 22.58 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=10%2025.11 | 21.36 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=20%2025.11 | 21.25 | |
| Q3RTarget rank (rtarget)=10%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.11 | 20.41 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.11 | 19.98 | |
| Q3RTarget rank (rtarget)=20%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.11 | 18.7 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.11 | 17.96 | |
| Vanilla ViT-TParameter Retention p=30%2025.11 | 16.24 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=15%2025.11 | 15.43 | |
| Vanilla ViT-TParameter Retention p=40%2025.11 | 15.24 | |
| Vanilla ViT-TParameter Retention p=5%2025.11 | 14.75 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=10%2025.11 | 14.33 | |
| Vanilla ViT-TParameter Retention p=15%2025.11 | 13.5 | |
| LoRITaRank (D)=3, Regularization weight (λ)=10^-3, Parameter Retention p=5%2025.11 | 13.38 | |
| Q3RTarget rank (rtarget)=15%, Regularization weight (λ)=10^-2, Parameter Retention p=5%2025.11 | 13.13 | |
| Vanilla ViT-TParameter Retention p=10%2025.11 | 12.52 | |
| Vanilla ViT-TParameter Retention p=20%2025.11 | 12.13 | |
| LoRITaRank (D)=2, Regularization weight (λ)=10^-1, Parameter Retention p=5%2025.11 | 9.89 |