Multi-task Model Merging Evaluation on Cross-task Utility Aggregate 8 Vision Datasets
67.23Average AccuracyUnprotected Baseline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Unprotected BaselineProtect=None, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.23 | — | |
| AGAProtect=Params-D, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.19 | 61.32 | |
| AGAProtect=Params, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.17 | 61.43 | |
| AGAProtect=MergeLock, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.17 | 62.25 | |
| AGAProtect=MergeBarrier, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 66.83 | 29.38 | |
| MergeBarrierProtect=MergeBarrier, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 37.45 | — | |
| Params-DProtect=Params-D, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 5.87 | — | |
| ParamsProtect=Params, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 5.74 | — | |
| MergeLockProtect=MergeLock, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 4.92 | — |