Continual Model Merging on Sequence 14-task
93.4ACCFine-Tuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fine-TunedBackbone=ViT-L/142026.04 | 93.4 | — | |
| Fine-TunedBackbone=ViT-L/142026.05 | 93.4 | — | |
| MADE-ITBackbone=ViT-L/142026.04 | 91.7 | -1 | |
| Fine-TunedBackbone=ViT-B/162026.04 | 91.3 | — | |
| Fine-TunedBackbone=ViT-B/162026.05 | 91.3 | — | |
| Fine-TunedBackbone=ViT-B/322026.04 | 89.3 | — | |
| Fine-TunedBackbone=ViT-B/322026.05 | 89.3 | — | |
| MINGLEBackbone=ViT-L/142026.04 | 88.8 | -1 | |
| MADE-ITBackbone=ViT-B/162026.04 | 87.7 | -1.9 | |
| ODE-MBackbone=ViT-L/142026.05 | 85.8 | -7.4 | |
| MINGLEBackbone=ViT-B/162026.04 | 84.9 | -0.9 | |
| MADE-ITBackbone=ViT-B/322026.04 | 84.3 | -2.6 | |
| OPCMBackbone=ViT-L/142026.04 | 83.5 | -4.3 | |
| OPCMBackbone=ViT-L/142026.05 | 83.5 | -4.3 | |
| MINGLEBackbone=ViT-B/322026.04 | 81.6 | -1.1 | |
| ODE-MBackbone=ViT-B/162026.05 | 78.5 | -8.1 | |
| Continual Ties-MergingBackbone=ViT-L/142026.04 | 78 | -1.1 | |
| C. Ties-MergingBackbone=ViT-L/142026.05 | 78 | 1.1 | |
| Continual Task ArithmeticBackbone=ViT-L/142026.04 | 77.9 | -1.8 | |
| C. Task ArithmeticBackbone=ViT-L/142026.05 | 77.9 | -1.8 | |
| Average (SWA)Backbone=ViT-L/142026.04 | 77.5 | -5.8 | |
| Average (SWA)Backbone=ViT-L/142026.05 | 77.5 | -5.8 | |
| OPCMBackbone=ViT-B/162026.04 | 77.1 | -5.1 | |
| OPCMBackbone=ViT-B/162026.05 | 77.1 | -5.1 | |
| ODE-MBackbone=ViT-B/322026.05 | 74.1 | -7.8 | |
| Continual LoRA-WEMoEBackbone=ViT-L/142026.04 | 74 | -16.8 | |
| Continual LW AdaMergingBackbone=ViT-L/142026.04 | 73.1 | -19.6 | |
| Continual Fine-TunedBackbone=ViT-B/162026.04 | 72.2 | — | |
| C. Fine-TunedBackbone=ViT-B/162026.05 | 72.2 | — | |
| OPCMBackbone=ViT-B/322026.04 | 71.9 | -6 | |
| OPCMBackbone=ViT-B/322026.05 | 71.9 | -6 | |
| Continual Task ArithmeticBackbone=ViT-B/162026.04 | 70.9 | -1.3 | |
| Continual Fine-TunedBackbone=ViT-L/142026.04 | 70.9 | — | |
| C. Task ArithmeticBackbone=ViT-B/162026.05 | 70.9 | -1.3 | |
| C. Fine-TunedBackbone=ViT-L/142026.05 | 70.9 | — | |
| Continual Ties-MergingBackbone=ViT-B/162026.04 | 70.5 | 1.4 | |
| C. Ties-MergingBackbone=ViT-B/162026.05 | 70.5 | 1.4 | |
| Average (SWA)Backbone=ViT-B/162026.04 | 69.7 | -7.1 | |
| Average (SWA)Backbone=ViT-B/162026.05 | 69.7 | -7.1 | |
| Pre-TrainedBackbone=ViT-L/142026.04 | 69.1 | — | |
| Pre-TrainedBackbone=ViT-L/142026.05 | 69.1 | — | |
| Continual LoRA-WEMoEBackbone=ViT-B/162026.04 | 67.9 | -18.8 | |
| Continual Fine-TunedBackbone=ViT-B/322026.04 | 67.4 | — | |
| C. Fine-TunedBackbone=ViT-B/322026.05 | 67.4 | — | |
| Continual Task ArithmeticBackbone=ViT-B/322026.04 | 66.5 | -1.3 | |
| C. Task ArithmeticBackbone=ViT-B/322026.05 | 66.5 | -1.3 | |
| Continual Ties-MergingBackbone=ViT-B/322026.04 | 66.2 | 1.9 | |
| C. Ties-MergingBackbone=ViT-B/322026.05 | 66.2 | 1.9 | |
| Average (SWA)Backbone=ViT-B/322026.04 | 65.4 | -8 | |
| Average (SWA)Backbone=ViT-B/322026.05 | 65.4 | -8 | |
| Continual LW AdaMergingBackbone=ViT-B/162026.04 | 64.3 | -22.1 | |
| Continual LoRA-WEMoEBackbone=ViT-B/322026.04 | 63.8 | -20.2 | |
| Pre-TrainedBackbone=ViT-B/162026.04 | 62 | — | |
| Pre-TrainedBackbone=ViT-B/162026.05 | 62 | — | |
| Continual LW AdaMergingBackbone=ViT-B/322026.04 | 59.8 | -24.1 | |
| Pre-TrainedBackbone=ViT-B/322026.04 | 56.9 | — | |
| Pre-TrainedBackbone=ViT-B/322026.05 | 56.9 | — |