Image Classification on 8-Vision benchmark (EuroSAT, GTSRB, SVHN, RESISC45, DTD, Cars, MNIST, SUN397) (test)
99Accuracy (EuroSAT)LoRA’s absolute accuracy
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LoRA’s absolute accuracyBackbone=ViT-B/322026.06 | 99 | 92.7 | 96.2 | 88.4 | 58.3 | 74 | 99.3 | 64.5 | — | — | — | |
| θBEvaluation Protocol=fine-tune, K=–2026.05 | 94.67 | 99.03 | 97.89 | 96.81 | 83.46 | 92.1 | 99.72 | 79.35 | 92.88 | 30.69 | — | |
| BiCoK=52026.05 | 78.25 | 81.96 | 72.69 | 85.65 | 68.45 | 87.68 | 92.21 | 73.11 | 80 | 17.81 | — | |
| BiCoK=22026.05 | 73.96 | 79.5 | 71.32 | 78.6 | 67.07 | 87.53 | 91.39 | 72.44 | 77.73 | 15.54 | — | |
| GradFixK=12026.05 | 69.67 | 60.32 | 57.28 | 73.02 | 56.91 | 85.5 | 87.66 | 71.34 | 70.21 | 8.02 | — | |
| BiCoK=12026.05 | 68 | 74.47 | 74.94 | 71.98 | 63.24 | 87.76 | 91.48 | 72.21 | 75.51 | 13.32 | — | |
| GradFixK=52026.05 | 65.3 | 63.78 | 65.06 | 71.85 | 57.18 | 82.92 | 89.48 | 71.08 | 70.83 | 8.64 | — | |
| DARE-TIESBackbone=ViT-B/32, Space=CtM2026.06 | 64.95 | 38.28 | 57.73 | 69.9 | 75 | 83.04 | 79.98 | 96.53 | 70.68 | — | — | |
| TIESBackbone=ViT-B/32, Space=CtM2026.06 | 64.46 | 38.5 | 50.93 | 70.67 | 75.27 | 82.87 | 78.22 | 97.07 | 69.75 | — | — | |
| GradFixK=22026.05 | 64.15 | 62.95 | 63.42 | 73.18 | 57.18 | 85.5 | 88.46 | 71.64 | 70.81 | 8.62 | — | |
| THESEUSK=52026.05 | 56.55 | 58.47 | 60.66 | 71.93 | 58.03 | 87.1 | 87.47 | 70.81 | 68.88 | 6.69 | — | |
| THESEUSK=22026.05 | 55.4 | 57.9 | 56.78 | 71.49 | 56.91 | 87.61 | 87.8 | 70.72 | 68.08 | 5.89 | — | |
| DARE-TIESBackbone=ViT-B/32, Space=CoreSpace2026.06 | 53.95 | 40.9 | 45.1 | 69.13 | 73.45 | 84.01 | 64.55 | 96.17 | 65.91 | — | 69.55 | |
| TIESBackbone=ViT-B/32, Space=CoreSpace2026.06 | 53.09 | 39.97 | 43.73 | 68.05 | 73.81 | 83.54 | 65.18 | 95.25 | 65.33 | — | 67.73 | |
| RobustMergeBackbone=ViT-B/322026.06 | 52.67 | 44.71 | 38.94 | 69.56 | 74.91 | 81.38 | 55.15 | 97.17 | 64.31 | — | — | |
| TransFusionK=–2026.05 | 50.3 | 49.48 | 52.57 | 68.27 | 56.65 | 88.6 | 73.51 | 70.51 | 63.74 | 1.55 | — | |
| THESEUSK=12026.05 | 50.18 | 60.23 | 60.77 | 70.63 | 56.8 | 87.45 | 84.04 | 70.8 | 67.61 | 5.42 | — | |
| θBEvaluation Protocol=zero-shot, K=–2026.05 | 50.15 | 48.35 | 50.05 | 68.22 | 55.96 | 88.56 | 65.79 | 70.44 | 62.19 | 0 | — | |
| TIESBackbone=ViT-B/32, Space=Full2026.06 | 49.94 | 36.93 | 43.15 | 69.22 | 72.9 | 82.51 | 55.41 | 96.95 | 63.38 | — | 63.94 | |
| DARE-TIESBackbone=ViT-B/32, Space=Full2026.06 | 49.57 | 37.03 | 42.75 | 69.31 | 72.81 | 82.51 | 56.12 | 96.9 | 63.37 | — | 64.03 | |
| Iso-CBackbone=ViT-B/32, Space=Full2026.06 | 49.42 | 42.96 | 44.14 | 71.18 | 74.18 | 82.98 | 62.95 | 97.99 | 65.72 | — | 75.91 | |
| Iso-CBackbone=ViT-B/32, Space=CoreSpace2026.06 | 49.31 | 42.92 | 44.17 | 71.12 | 74.08 | 82.98 | 63.1 | 97.99 | 65.71 | — | 75.87 | |
| LoRA-LEGOBackbone=ViT-B/322026.06 | 47.03 | 38.89 | 40.9 | 69.83 | 72.72 | 81.42 | 50.88 | 97.21 | 62.36 | — | — | |
| TIESBackbone=ViT-B/32, Space=KnOTS2026.06 | 46.61 | 38.66 | 44.22 | 69.27 | 72.99 | 82.35 | 56.5 | 96.44 | 63.38 | — | 64.4 | |
| DARE-TIESBackbone=ViT-B/32, Space=KnOTS2026.06 | 46.61 | 38.66 | 44.22 | 69.27 | 72.99 | 82.35 | 56.5 | 96.44 | 63.38 | — | 64.55 | |
| Iso-CBackbone=ViT-B/32, Space=KnOTS2026.06 | 46.35 | 38.76 | 37.17 | 69.83 | 73.81 | 80.37 | 48.94 | 97.32 | 61.57 | — | 64.61 | |
| Iso-CBackbone=ViT-B/32, Space=CtM2026.06 | 44.37 | 56.45 | 43.55 | 73.69 | 77.55 | 80.83 | 56.03 | 97.72 | 66.27 | — | — | |
| Iso-CTSBackbone=ViT-B/322026.06 | 42.99 | 53.01 | 43.98 | 74.1 | 76.91 | 81.93 | 59.42 | 98.35 | 66.34 | — | — | |
| θB + τAK=–2026.05 | 36.07 | 33.96 | 20.33 | 63.16 | 54.73 | 86.82 | 72.09 | 66.74 | 54.24 | -7.95 | — |