Image Classification on SUN397 (Accuracy, NLL, ECE, Brier)
79.28AccuracyEVON
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EVONOptimizer=EVON, Monte Carlo samples (BMA)=32, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 79.28 | 0.695 | 1.3 | 0.296 | |
| EVONOptimizer=EVON, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 78.84 | 0.758 | 6.54 | 0.308 | |
| AdamWOptimizer=AdamW, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 77.85 | 0.854 | 9.03 | 0.33 | |
| SOAPOptimizer=SOAP, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 77.51 | 0.832 | 7.57 | 0.329 | |
| IVONOptimizer=IVON, Monte Carlo samples (BMA)=32, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 77.27 | 0.775 | 3.75 | 0.324 | |
| IVONOptimizer=IVON, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 77.21 | 0.791 | 4.84 | 0.327 | |
| Unprotected BaselineBackbone=ViT-L/14, Protect=-, Attack=-2026.06 | 73.83 | — | — | — | |
| AGABackbone=ViT-L/14, Protect=Params [18], Attack=AGA2026.06 | 73.36 | — | — | — | |
| AGABackbone=ViT-L/14, Protect=MergeLock [36], Attack=AGA2026.06 | 73.36 | — | — | — | |
| AGABackbone=ViT-L/14, Protect=Params-P [18], Attack=AGA2026.06 | 72.44 | — | — | — | |
| AGABackbone=ViT-L/14, Protect=MergeBarrier [22], Attack=AGA2026.06 | 71.16 | — | — | — | |
| AGAProtect=Params-D, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.25 | — | — | — | |
| Unprotected BaselineProtect=None, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.23 | — | — | — | |
| AGAProtect=Params, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.19 | — | — | — | |
| AGAProtect=MergeLock, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.19 | — | — | — | |
| AGAProtect=MergeBarrier, Attack=AGA, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 67.17 | — | — | — | |
| No ProtectionProtect=-, Attack=-, Backbone=ViT-B/322026.06 | 61.75 | — | — | — | |
| Unprotected BaselineProtect=None, Attack=None, Backbone=ViT-B/322026.06 | 61.75 | — | — | — | |
| MergeLockProtect=MergeLock [36], Attack=AGA, Backbone=ViT-B/322026.06 | 61.5 | — | — | — | |
| AGAProtect=Params & MergeLock, Attack=AGA, Backbone=ViT-B/322026.06 | 61.5 | — | — | — | |
| AGAProtect=Params & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 58.56 | — | — | — | |
| AGAProtect=MergeLock & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 58.56 | — | — | — | |
| AGAProtect=Params & MergeLock & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 58.54 | — | — | — | |
| MergeGuardProtect=MergeGuard [5], Attack=AGA, Backbone=ViT-B/322026.06 | 46.23 | — | — | — | |
| MergeGuardProtect=MergeGuard [5], Attack=-, Backbone=ViT-B/322026.06 | 43.52 | — | — | — | |
| MergeBarrierProtect=MergeBarrier, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 38.68 | — | — | — | |
| ARFProtect=ARF, Attack=AGA, Backbone=ViT-B/322026.06 | 38.18 | — | — | — | |
| Combined Defense (P & B)Protect=Params & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 11.16 | — | — | — | |
| ParamsProtect=Params, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 5.74 | — | — | — | |
| Params-DProtect=Params-D, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 5.68 | — | — | — | |
| MergeBarrierBackbone=ViT-L/14, Protect=MergeBarrier [22], Attack=-2026.06 | 5.59 | — | — | — | |
| MergeLockProtect=MergeLock, Attack=None, Backbone=ViT-B/32, Merging Paradigm=Task Arithmetic2026.06 | 3.84 | — | — | — | |
| ParamsBackbone=ViT-L/14, Protect=Params [18], Attack=-2026.06 | 0.39 | — | — | — | |
| MergeLockBackbone=ViT-L/14, Protect=MergeLock [36], Attack=-2026.06 | 0.32 | — | — | — | |
| Params-PBackbone=ViT-L/14, Protect=Params-P [18], Attack=-2026.06 | 0.31 | — | — | — | |
| MergeLockProtect=MergeLock [36], Attack=-, Backbone=ViT-B/322026.06 | 0.3 | — | — | — | |
| Combined Defense (L & B)Protect=MergeLock & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 0.3 | — | — | — | |
| ARFProtect=ARF, Attack=-, Backbone=ViT-B/322026.06 | 0.28 | — | — | — | |
| Combined Defense (P & L & B)Protect=Params & MergeLock & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 0.27 | — | — | — | |
| Combined Defense (P & L)Protect=Params & MergeLock, Attack=None, Backbone=ViT-B/322026.06 | 0.26 | — | — | — |