Image Classification on CIFAR-10-C (test) (Calibration Evaluation)
2.1ECElowrank-KFAC
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| lowrank-KFACcorruption=gaussian blur, s=3002025.02 | 2.1 | 0.341 | 0.164 | — | |
| lowrank-KFACcorruption=gaussian blur, s=2002025.02 | 2.2 | 0.341 | 0.164 | — | |
| lowrank-KFACcorruption=gaussian blur, s=1002025.02 | 2.3 | 0.342 | 0.164 | — | |
| DFLModel=ViT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 2.62 | — | — | 90.37 | |
| FGRModel=ViT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 2.8 | — | — | 90.79 | |
| FGRModel=DeiT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 2.98 | — | — | 89.31 | |
| DFLModel=DeiT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 2.99 | — | — | 89.68 | |
| lowrank-KFACcorruption=brightness, s=3002025.02 | 3.4 | 0.312 | 0.145 | — | |
| lowrank-KFACcorruption=brightness, s=2002025.02 | 3.5 | 0.313 | 0.145 | — | |
| lowrank-KFACcorruption=brightness, s=1002025.02 | 3.6 | 0.316 | 0.145 | — | |
| lowrank-D.corruption=brightness, s=1002025.02 | 4.5 | 0.342 | 0.149 | — | |
| subset-M.corruption=brightness, s=1002025.02 | 4.5 | 0.341 | 0.149 | — | |
| subset-SWAGcorruption=brightness, s=1002025.02 | 4.5 | 0.342 | 0.149 | — | |
| subset-D.corruption=brightness, s=1002025.02 | 4.6 | 0.344 | 0.149 | — | |
| θˆcorruption=brightness, s=1002025.02 | 4.6 | 0.344 | 0.149 | — | |
| FGRModel=Swin-Tiny, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 4.79 | — | — | 86.39 | |
| lowrank-KFACcorruption=elastic transform, s=3002025.02 | 4.9 | 0.488 | 0.225 | — | |
| lowrank-KFACcorruption=elastic transform, s=2002025.02 | 5 | 0.49 | 0.225 | — | |
| lowrank-KFACcorruption=elastic transform, s=1002025.02 | 5.1 | 0.492 | 0.226 | — | |
| DFLModel=Swin-Tiny, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 5.21 | — | — | 85.23 | |
| CEModel=ViT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 5.47 | — | — | 90.19 | |
| lowrank-KFACcorruption=motion blur, s=3002025.02 | 5.7 | 0.556 | 0.254 | — | |
| CEModel=DeiT-Small, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 5.79 | — | — | 89.12 | |
| lowrank-KFACcorruption=motion blur, s=2002025.02 | 5.9 | 0.558 | 0.254 | — | |
| lowrank-KFACcorruption=motion blur, s=1002025.02 | 6 | 0.56 | 0.255 | — | |
| lowrank-D.corruption=elastic transform, s=1002025.02 | 6.4 | 0.524 | 0.23 | — | |
| CEModel=Swin-Tiny, Pre-training=ImageNet-pretrained, Fine-tuning=Full-parameter2025.08 | 8.38 | — | — | 84.62 | |
| lowrank-KFACcorruption=speckle noise, s=3002025.02 | 16.8 | 1.324 | 0.475 | — | |
| lowrank-KFACcorruption=speckle noise, s=2002025.02 | 17 | 1.335 | 0.476 | — | |
| lowrank-KFACcorruption=speckle noise, s=1002025.02 | 17.2 | 1.352 | 0.478 | — | |
| lowrank-KFACcorruption=shot noise, s=3002025.02 | 17.6 | 1.371 | 0.493 | — | |
| lowrank-KFACcorruption=shot noise, s=2002025.02 | 17.8 | 1.383 | 0.495 | — | |
| lowrank-KFACcorruption=shot noise, s=1002025.02 | 18.1 | 1.4 | 0.496 | — | |
| subset-SWAGcorruption=speckle noise, s=3002025.02 | 18.7 | 1.465 | 0.489 | — | |
| lowrank-KFACcorruption=impulse noise, s=3002025.02 | 20 | 1.647 | 0.593 | — | |
| lowrank-KFACcorruption=impulse noise, s=1002025.02 | 20.6 | 1.679 | 0.597 | — | |
| lowrank-D.corruption=impulse noise, s=1002025.02 | 23 | 1.841 | 0.614 | — |