Image Classification on SVHN (Accuracy and Calibration Metrics)
97.41AccuracyEVON
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EVONOptimizer=EVON, Monte Carlo samples (BMA)=32, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 97.41 | 0.117 | 0.0273 | 0.043 | |
| EVONOptimizer=EVON, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 97.35 | 0.129 | 0.0098 | 0.045 | |
| IVONOptimizer=IVON, Monte Carlo samples (BMA)=32, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 97.01 | 0.129 | 0.0079 | 0.048 | |
| IVONOptimizer=IVON, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 96.98 | 0.132 | 0.0069 | 0.049 | |
| SOAPOptimizer=SOAP, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 96.92 | 0.141 | 0.0069 | 0.051 | |
| AdamWOptimizer=AdamW, Monte Carlo samples (BMA)=1, Backbone=ViT-B/16, Pre-training=OpenAI CLIP, Fine-tuning protocol=linear layers (99% of parameters)2026.06 | 96.76 | 0.133 | 0.0078 | 0.052 | |
| Unprotected BaselineProtect=None, Attack=None, Backbone=ViT-B/322026.06 | 83.25 | — | — | — | |
| AGAProtect=Params & MergeLock, Attack=AGA, Backbone=ViT-B/322026.06 | 81.15 | — | — | — | |
| AGAProtect=Params & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 73.79 | — | — | — | |
| AGAProtect=MergeLock & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 73.7 | — | — | — | |
| AGAProtect=Params & MergeLock & MergeBarrier, Attack=AGA, Backbone=ViT-B/322026.06 | 73.7 | — | — | — | |
| Combined Defense (P & B)Protect=Params & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 9.71 | — | — | — | |
| Combined Defense (P & L)Protect=Params & MergeLock, Attack=None, Backbone=ViT-B/322026.06 | 9.68 | — | — | — | |
| Combined Defense (L & B)Protect=MergeLock & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 9.25 | — | — | — | |
| Combined Defense (P & L & B)Protect=Params & MergeLock & MergeBarrier, Attack=None, Backbone=ViT-B/322026.06 | 9.1 | — | — | — |