Image Classification on 16 Vision Tasks Suite (ViT-B/32, test)
80.46Cars AccuracyDARE-TIES
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DARE-TIESSpace=KnOTS, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.46 | 75.27 | 46.13 | 35.11 | 48.48 | 68.38 | 97.9 | 32.77 | 89.11 | 81.86 | 75.47 | 98.63 | 93.52 | 98.26 | 57.25 | 70.78 | 71.84 | 72.34 | |
| TIESSpace=KnOTS, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.39 | 75.09 | 45.94 | 35.42 | 48.65 | 68.52 | 97.86 | 32.94 | 89.26 | 82.07 | 75.47 | 98.71 | 93.4 | 98.22 | 57.33 | 71.36 | 71.91 | 72.27 | |
| Base ModelBackbone=ViT-B/322026.06 | 80.33 | 75.55 | 46.32 | 34.75 | 48.35 | 68.25 | 98.03 | 32.63 | 89.11 | 81.86 | 75.28 | 98.71 | 93.74 | 98.23 | 57.38 | 70.21 | 71.8 | — | |
| Iso-CSpace=CoreSpace, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.31 | 74.27 | 43.55 | 37.76 | 50.91 | 68.72 | 97.9 | 34.94 | 89.48 | 83.52 | 75.89 | 98.95 | 93.78 | 98.53 | 58.1 | 72.65 | 72.45 | 77.96 | |
| DARE-TIESSpace=Full, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.29 | 75.27 | 46.2 | 35.09 | 48.36 | 68.3 | 97.91 | 32.81 | 89.18 | 81.93 | 75.4 | 98.63 | 93.52 | 98.23 | 57.6 | 70.7 | 71.84 | 72.15 | |
| Iso-CSpace=Full, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.27 | 74.18 | 43.58 | 37.77 | 50.76 | 68.68 | 97.91 | 34.91 | 89.45 | 83.66 | 75.89 | 99.03 | 93.74 | 98.55 | 58.05 | 72.61 | 72.44 | 77.92 | |
| TIESSpace=Full, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.27 | 75.36 | 46.13 | 34.92 | 48.34 | 68.3 | 97.9 | 32.73 | 89.22 | 81.89 | 75.43 | 98.63 | 93.48 | 98.24 | 57.5 | 70.81 | 71.82 | 72.08 | |
| RobustMergeBackbone=ViT-B/322026.06 | 80.12 | 74.72 | 46.84 | 37.88 | 49.86 | 68.7 | 98.03 | 33.91 | 89.86 | 82.79 | 75.7 | 98.95 | 93.37 | 98.44 | 56.52 | 71.8 | 72.34 | — | |
| TIESSpace=CoreSpace, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.03 | 75.27 | 46.02 | 35.64 | 49.26 | 68.65 | 97.92 | 33.17 | 89.37 | 83.1 | 75.78 | 99.03 | 93.48 | 98.27 | 57.98 | 72.62 | 72.22 | 74.16 | |
| DARE-TIESSpace=CoreSpace, Backbone=ViT-B/32, Target rank (r)=162026.06 | 80.03 | 75.27 | 45.9 | 37.26 | 49.13 | 68.93 | 97.47 | 33.44 | 89.45 | 83.45 | 75.87 | 99.35 | 93.59 | 98.24 | 56.42 | 72.9 | 72.29 | 74.16 | |
| LoRA-LEGOBackbone=ViT-B/322026.06 | 79.97 | 73.63 | 45.3 | 38.29 | 48.97 | 68.68 | 97.76 | 34.1 | 89.67 | 82.79 | 75.91 | 98.79 | 93.03 | 98.33 | 57.55 | 72.78 | 72.22 | — | |
| Iso-CSpace=KnOTS, Backbone=ViT-B/32, Target rank (r)=162026.06 | 79.87 | 74.81 | 44.41 | 37.11 | 48.64 | 68.63 | 97.91 | 32.75 | 89.79 | 82.62 | 75.99 | 98.87 | 93.48 | 98.42 | 57.25 | 72.39 | 72.06 | 72.83 | |
| CtMSpace=CtM (ours), Merge Operator=DARE-TIES, Backbone=ViT-B/32, Target rank (r)=162026.06 | 79.8 | 73.63 | 48.63 | 37.23 | 53.95 | 68.97 | 97.91 | 38.72 | 89.67 | 82.07 | 73.87 | 98.79 | 94.01 | 97.52 | 60.98 | 73.5 | 73.08 | — | |
| CtMSpace=CtM (ours), Merge Operator=TIES, Backbone=ViT-B/32, Target rank (r)=162026.06 | 79.74 | 74.27 | 48.56 | 37.2 | 53.69 | 68.97 | 97.83 | 38.29 | 89.67 | 82.14 | 74.04 | 98.79 | 93.97 | 97.67 | 60.66 | 73.27 | 73.05 | — | |
| CtMSpace=CtM (ours), Merge Operator=Iso-C, Backbone=ViT-B/32, Target rank (r)=162026.06 | 79.72 | 76.18 | 46.32 | 44.73 | 50.62 | 72.65 | 98.21 | 38.16 | 89.67 | 82.2 | 74.8 | 98.71 | 93.1 | 98.17 | 54.62 | 69.93 | 72.99 | — | |
| LoRA's absolute accuracyBackbone=ViT-B/322026.06 | 74 | 58.3 | 99 | 92.7 | 99.3 | 88.4 | 64.5 | 96.2 | 95.43 | 62.53 | 85.4 | 88.61 | 90.46 | 84.87 | 69.55 | 94 | — | — |