Image Classification on Stanford Cars (Accuracy)
95.22Top-1 AccuracyθB fine-tune
Evaluation Results
| Method | Links | |
|---|---|---|
| θB fine-tuneTarget Backbone=ViT-L/14, Target Pre-training=Datacomp-XL, Evaluation Protocol=fine-tune2026.05 | 95.22 | |
| BiCoSource Backbone=ViT-B/16, Source Pre-training=LAION-2B, Target Backbone=ViT-L/14, Target Pre-training=Datacomp-XL, N=100, Evaluation Protocol=task-vector transfer2026.05 | 93.79 | |
| THESEUSSource Backbone=ViT-B/16, Source Pre-training=LAION-2B, Target Backbone=ViT-L/14, Target Pre-training=Datacomp-XL, N=100, Evaluation Protocol=task-vector transfer2026.05 | 93.17 | |
| θB + τA paddedSource Backbone=ViT-B/16, Source Pre-training=LAION-2B, Target Backbone=ViT-L/14, Target Pre-training=Datacomp-XL, Evaluation Protocol=task-vector transfer2026.05 | 93.13 | |
| θB zero-shotTarget Backbone=ViT-L/14, Target Pre-training=Datacomp-XL, Evaluation Protocol=zero-shot2026.05 | 93.06 | |
| Traditional MTLBackbone=ViT-L/142026.04 | 92.84 | |
| Auto-SwitchType=Dynamic, Storage (MB)=556.88, Backbone=ViT-L/142026.04 | 92.61 | |
| Auto-FlexSwitch+KL (λ = 0.3)Type=Dynamic, Storage (MB)=80.69, Backbone=ViT-L/142026.04 | 92.58 | |
| Auto-FlexSwitch+MSE (λ = 0.05)Type=Dynamic, Storage (MB)=98.41, Backbone=ViT-L/142026.04 | 92.56 | |
| theta_A fine-tuneN=–2026.05 | 92.5 | |
| Auto-FlexSwitch+CKA (λ = 3)Type=Dynamic, Storage (MB)=89.76, Backbone=ViT-L/142026.04 | 92.35 | |
| IndividualBackbone=ViT-L/142026.04 | 92.34 | |
| FAR-TinyParams (M)=7.5, FLOPs (G)=1.45, Structured Compression=false, Fine-tuning=true2025.05 | 92.3 | |
| FAR-BaseParams (M)=83.2, FLOPs (G)=17.31, Structured Compression=false, Fine-tuning=true2025.05 | 92.3 | |
| FAR-SmallParams (M)=23.9, FLOPs (G)=4.82, Structured Compression=false, Fine-tuning=true2025.05 | 92.1 | |
| DeiT-BaseParams (M)=86.5, FLOPs (G)=17.56, Structured Compression=false, Fine-tuning=true2025.05 | 92.1 | |
| θA fine-tuneSource Backbone=ViT-B/16, Source Pre-training=LAION-2B, Evaluation Protocol=fine-tune2026.05 | 92.1 | |
| DeiT-SmallParams (M)=22.1, FLOPs (G)=4.60, Structured Compression=false, Fine-tuning=true2025.05 | 91.7 | |
| MoW-MergingType=Dynamic, Storage (MB)=5159.51, Backbone=ViT-L/142026.04 | 91.32 | |
| EMR-MergingType=Dynamic, Storage (MB)=1633.46, Backbone=ViT-L/142026.04 | 90.71 | |
| DeiT-TinyParams (M)=5.7, FLOPs (G)=1.25, Structured Compression=false, Fine-tuning=true2025.05 | 90.5 | |
| FAR-Small (Pruned)Params (M)=20.3, FLOPs (G)=3.90, Structured Compression=true, Fine-tuning=true2025.05 | 90.5 | |
| AdaMerging++Type=Static, Backbone=ViT-L/142026.04 | 90.48 | |
| Twin-MergingType=Dynamic, Storage (MB)=1780.62, Backbone=ViT-L/142026.04 | 90.16 | |
| theta_B fine-tuneN=–2026.05 | 90.11 | |
| DF-MergeType=Static, Backbone=ViT-L/142026.04 | 89.95 | |
| FAR-Base (Pruned)Params (M)=73.0, FLOPs (G)=14.80, Structured Compression=true, Fine-tuning=true2025.05 | 89.8 | |
| AdaMergingType=Static, Backbone=ViT-L/142026.04 | 89.65 | |
| S2-FracMixBackbone=CLIP ResNet-50, Evaluation Protocol=Fine-tuning2026.06 | 89.63 | |
| FAR-Tiny (Pruned)Params (M)=5.7, FLOPs (G)=1.08, Structured Compression=true, Fine-tuning=true2025.05 | 89.5 | |
| S2-FracMixBackbone=DINOv2 ViT-S, Evaluation Protocol=Fine-tuning2026.06 | 88.68 | |
| CutMixBackbone=DINOv2 ViT-S, Evaluation Protocol=Fine-tuning2026.06 | 88.53 | |
| MixupBackbone=DINOv2 ViT-S, Evaluation Protocol=Fine-tuning2026.06 | 88.32 | |
| No AugmentationBackbone=DINOv2 ViT-S, Evaluation Protocol=Fine-tuning2026.06 | 88.3 | |
| MixupBackbone=CLIP ResNet-50, Evaluation Protocol=Fine-tuning2026.06 | 88.27 | |
| CutMixBackbone=CLIP ResNet-50, Evaluation Protocol=Fine-tuning2026.06 | 88.24 | |
| RegMeanType=Static, Backbone=ViT-L/142026.04 | 87.17 | |
| No AugmentationBackbone=CLIP ResNet-50, Evaluation Protocol=Fine-tuning2026.06 | 87.1 | |
| ViT-BAdaptation Strategy=Fine-tuning, Params=85.8M, Pre-training Dataset=ImageNet-1K2026.05 | 86.8 | |
| BiCoN=1002026.05 | 85.23 | |
| bViT-BAdaptation Strategy=Fine-tuning, Params=7.8M, Pre-training Dataset=ImageNet-1K2026.05 | 85.2 | |
| BiCoN=502026.05 | 84.9 | |
| BiCoN=202026.05 | 84.6 | |
| BiCoN=102026.05 | 84.59 | |
| theta_B zero-shotN=–2026.05 | 84.5 | |
| THESEUSN=502026.05 | 84.4 | |
| THESEUSN=1002026.05 | 84.39 | |
| THESEUSN=202026.05 | 84.16 | |
| THESEUSN=102026.05 | 84.11 | |
| Ties-MergingType=Static, Backbone=ViT-L/142026.04 | 83.09 | |
| theta_B + tau_A^paddedN=–2026.05 | 82.83 | |
| Task-ArithmeticType=Static, Backbone=ViT-L/142026.04 | 82.14 | |
| Fisher MergingType=Static, Backbone=ViT-L/142026.04 | 81.57 | |
| Weight-AveragingType=Static, Backbone=ViT-L/142026.04 | 81.54 | |
| ViT-BAdaptation Strategy=LoRA, FFN, Params=738K, Pre-training Dataset=ImageNet-1K2026.05 | 81.2 | |
| ViT-BAdaptation Strategy=LoRA, QV, Params=296K, Pre-training Dataset=ImageNet-1K2026.05 | 81.1 | |
| DAREType=Static, Backbone=ViT-L/142026.04 | 79.41 | |
| bViT-BAdaptation Strategy=LoRA, FFN, Params=62K, Pre-training Dataset=ImageNet-1K2026.05 | 79.2 | |
| Auto-FlexSwitch+CKA (λ = 3)Type=Dynamic, Storage (MB)=47.26, Backbone=ViT-B/322026.04 | 79.12 | |
| Auto-SwitchType=Dynamic, Storage (MB)=185.28, Backbone=ViT-B/322026.04 | 78.47 | |
| Auto-FlexSwitch+KL (λ = 0.3)Type=Dynamic, Storage (MB)=41.51, Backbone=ViT-B/322026.04 | 78.4 | |
| Auto-FlexSwitch+MSE (λ = 0.05)Type=Dynamic, Storage (MB)=50.72, Backbone=ViT-B/322026.04 | 78.21 | |
| Pre-trainedBackbone=ViT-L/142026.04 | 77.86 | |
| IndividualBackbone=ViT-B/322026.04 | 77.66 | |
| bViT-BAdaptation Strategy=LoRA, QV, Params=25K, Pre-training Dataset=ImageNet-1K2026.05 | 76.8 | |
| Traditional MTLBackbone=ViT-B/322026.04 | 74.76 | |
| Twin-MergingType=Dynamic, Storage (MB)=711.10, Backbone=ViT-B/322026.04 | 73.26 | |
| EMR-MergingType=Dynamic, Storage (MB)=540.19, Backbone=ViT-B/322026.04 | 72.75 | |
| AdaMerging++Type=Static, Backbone=ViT-B/322026.04 | 69.89 | |
| MoW-MergingType=Dynamic, Storage (MB)=2171.89, Backbone=ViT-B/322026.04 | 68.95 | |
| AdaMergingType=Static, Backbone=ViT-B/322026.04 | 68.85 | |
| RAR (LLaVA1.5)Shots=162024.03 | 67.8 | |
| Fisher MergingType=Static, Backbone=ViT-B/322026.04 | 67.07 | |
| RegMeanType=Static, Backbone=ViT-B/322026.04 | 66.87 | |
| MMRL + NeRP2026.05 | 66.6 | |
| MMA + NeRP2026.05 | 66.53 | |
| bViT-BAdaptation Strategy=Time embedding tuning, Params=9K, Pre-training Dataset=ImageNet-1K2026.05 | 66.2 | |
| PromptSRC + NeRP2026.05 | 66.2 | |
| MMA2026.05 | 66.13 | |
| MMRL2026.05 | 66.1 | |
| PromptSRC2026.05 | 65.7 | |
| CoCoOp + NeRP2026.05 | 65.35 | |
| CoCoOp2026.05 | 65.32 | |
| DF-MergeType=Static, Backbone=ViT-B/322026.04 | 64.53 | |
| Weight-AveragingType=Static, Backbone=ViT-B/322026.04 | 63.34 | |
| CLIP+KNNShots=162024.03 | 63.2 | |
| Task-ArithmeticType=Static, Backbone=ViT-B/322026.04 | 62.06 | |
| DAREType=Static, Backbone=ViT-B/322026.04 | 62.06 | |
| Ties-MergingType=Static, Backbone=ViT-B/322026.04 | 61.42 | |
| RAR (LLaVA1.5)Shots=82024.03 | 61.2 | |
| Pre-trainedBackbone=ViT-B/322026.04 | 59.64 | |
| CLIP+KNNShots=82024.03 | 56.1 | |
| bViT-BAdaptation Strategy=Linear probing, Params=—, Pre-training Dataset=ImageNet-1K2026.05 | 54.8 | |
| RAR (LLaVA1.5)Shots=42024.03 | 54.4 | |
| CLIP2026.04 | 52.13 | |
| CLIP+KNNShots=42024.03 | 49.2 | |
| FARE2026.04 | 48.68 | |
| AdvFLYPfull2026.04 | 48.1 | |
| ViT-BAdaptation Strategy=Linear probing, Params=—, Pre-training Dataset=ImageNet-1K2026.05 | 48 | |
| RAR (LLaVA1.5)Shots=22024.03 | 45.9 |