Image Classification Calibration on CIFAR100
0.0096Classwise ECEBalCAL
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BalCALBackbone=ViT-B/162025.04 | 0.0096 | 92.69 | 0.0097 | — | — | — | — | — | — | — | |
| TSTBackbone=ViT-B/162025.04 | 0.0109 | 92.1 | 0.0127 | — | — | — | — | — | — | — | |
| DualFocalBackbone=ViT-B/162025.04 | 0.0125 | 92.73 | 0.0105 | — | — | — | — | — | — | — | |
| MMCEBackbone=ViT-B/162025.04 | 0.0127 | 92.76 | 0.0108 | — | — | — | — | — | — | — | |
| VTSTBackbone=ViT-B/162025.04 | 0.0149 | 92.67 | 0.0134 | — | — | — | — | — | — | — | |
| VanillaBackbone=ViT-B/162025.04 | 0.0175 | 92.67 | 0.0145 | — | — | — | — | — | — | — | |
| TSK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.0386 | 59.9 | — | — | 1.6418 | 0.5462 | — | — | — | — | |
| Binwise-TSK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.0387 | 59.9 | — | — | 1.6487 | 0.5467 | — | — | — | — | |
| clustered Temperature ScalingK (Number of clusters)=10, λ (Shrinkage parameter)=0.052025.10 | 0.0415 | 59.9 | — | — | 1.679 | 0.5475 | — | — | — | — | |
| clustered Vector scalingK (Number of clusters)=10, λ (Shrinkage parameter)=0.052025.10 | 0.0481 | 60.09 | — | — | 1.6157 | 0.5412 | — | — | — | — | |
| VectorK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.0532 | 59.98 | — | — | 1.6257 | 0.5431 | — | — | — | — | |
| Binwise-VectorK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.0923 | 58.71 | — | — | 1.9328 | 0.5715 | — | — | — | — | |
| DirichletK (Number of clusters)=10, λ (Shrinkage parameter)=0.052025.10 | 0.1315 | 52.68 | — | — | 5.2155 | 0.6876 | — | — | — | — | |
| FLSDModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.18 | — | — | — | — | — | — | — | — | — | |
| DirichletK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.1875 | 51.46 | — | — | 3.3938 | 0.6823 | — | — | — | — | |
| FLSDModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| DFLModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.19 | — | — | — | — | — | — | — | — | — | |
| DFLModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.2 | — | — | — | — | — | — | — | — | — | |
| AFLModel=ResNet-1102026.04 | 0.2 | — | — | 0.21 | — | — | — | — | — | — | |
| FLSDModel=Wide-ResNet2026.04 | 0.2 | — | — | 0.2 | — | — | — | — | — | — | |
| DFLModel=Wide-ResNet2026.04 | 0.2 | — | — | 0.2 | — | — | — | — | — | — | |
| AFLModel=Wide-ResNet2026.04 | 0.2 | — | — | 0.22 | — | — | — | — | — | — | |
| GCEModel=Wide-ResNet2026.04 | 0.2 | — | — | 0.21 | — | — | — | — | — | — | |
| CEModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| DFLModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| DFLModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| DFLModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCE-GRAModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| CEModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| DFLModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| BSCEModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.21 | — | — | — | — | — | — | — | — | — | |
| AFLModel=ResNet-502026.04 | 0.21 | — | — | 0.22 | — | — | — | — | — | — | |
| Brier LossModel=Wide-ResNet2026.04 | 0.21 | — | — | 0.21 | — | — | — | — | — | — | |
| AFLModel=DenseNet-1212026.04 | 0.21 | — | — | 0.22 | — | — | — | — | — | — | |
| CEModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.22 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.22 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.22 | — | — | — | — | — | — | — | — | — | |
| BLModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.22 | — | — | — | — | — | — | — | — | — | |
| BLModel=WideResNet, Temperature Scaling=Post T2025.03 | 0.22 | — | — | — | — | — | — | — | — | — | |
| FLSDModel=ResNet-502026.04 | 0.22 | — | — | 0.22 | — | — | — | — | — | — | |
| DFLModel=ResNet-502026.04 | 0.22 | — | — | 0.23 | — | — | — | — | — | — | |
| GCEModel=ResNet-502026.04 | 0.22 | — | — | 0.28 | — | — | — | — | — | — | |
| FLSDModel=ResNet-1102026.04 | 0.22 | — | — | 0.24 | — | — | — | — | — | — | |
| GCEModel=ResNet-1102026.04 | 0.22 | — | — | 0.31 | — | — | — | — | — | — | |
| CEModel=Wide-ResNet2026.04 | 0.22 | — | — | 0.34 | — | — | — | — | — | — | |
| MMCEModel=Wide-ResNet2026.04 | 0.22 | — | — | 0.32 | — | — | — | — | — | — | |
| Brier LossModel=DenseNet-1212026.04 | 0.22 | — | — | 0.22 | — | — | — | — | — | — | |
| FLSDModel=DenseNet-1212026.04 | 0.22 | — | — | 0.22 | — | — | — | — | — | — | |
| DFLModel=DenseNet-1212026.04 | 0.22 | — | — | 0.26 | — | — | — | — | — | — | |
| GCEModel=DenseNet-1212026.04 | 0.22 | — | — | 0.28 | — | — | — | — | — | — | |
| BLModel=ResNet110, Temperature Scaling=Post T2025.03 | 0.23 | — | — | — | — | — | — | — | — | — | |
| DFLModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.23 | — | — | — | — | — | — | — | — | — | |
| CEModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.23 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.23 | — | — | — | — | — | — | — | — | — | |
| CEModel=ResNet-502026.04 | 0.23 | — | — | 0.39 | — | — | — | — | — | — | |
| Brier LossModel=ResNet-502026.04 | 0.23 | — | — | 0.22 | — | — | — | — | — | — | |
| MMCEModel=ResNet-502026.04 | 0.23 | — | — | 0.26 | — | — | — | — | — | — | |
| CEModel=ResNet-1102026.04 | 0.23 | — | — | 0.41 | — | — | — | — | — | — | |
| Brier LossModel=ResNet-1102026.04 | 0.23 | — | — | 0.24 | — | — | — | — | — | — | |
| MMCEModel=ResNet-1102026.04 | 0.23 | — | — | 0.41 | — | — | — | — | — | — | |
| DFLModel=ResNet-1102026.04 | 0.23 | — | — | 0.23 | — | — | — | — | — | — | |
| BLModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.24 | — | — | — | — | — | — | — | — | — | |
| BLModel=ResNet50, Temperature Scaling=Post T2025.03 | 0.24 | — | — | — | — | — | — | — | — | — | |
| BLModel=DenseNet, Temperature Scaling=Post T2025.03 | 0.24 | — | — | — | — | — | — | — | — | — | |
| DFLModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.24 | — | — | — | — | — | — | — | — | — | |
| CEModel=DenseNet-1212026.04 | 0.24 | — | — | 0.42 | — | — | — | — | — | — | |
| MMCEModel=DenseNet-1212026.04 | 0.24 | — | — | 0.39 | — | — | — | — | — | — | |
| BLModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.25 | — | — | — | — | — | — | — | — | — | |
| BaseK (Number of clusters)=-, λ (Shrinkage parameter)=-2025.10 | 0.2607 | 59.9 | — | — | 2.3367 | 0.641 | — | — | — | — | |
| MMCEModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.32 | — | — | — | — | — | — | — | — | — | |
| CEModel=WideResNet, Temperature Scaling=Pre T2025.03 | 0.33 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.36 | — | — | — | — | — | — | — | — | — | |
| BLModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.38 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.39 | — | — | — | — | — | — | — | — | — | |
| CEModel=ResNet50, Temperature Scaling=Pre T2025.03 | 0.4 | — | — | — | — | — | — | — | — | — | |
| CEModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.41 | — | — | — | — | — | — | — | — | — | |
| MMCEModel=ResNet110, Temperature Scaling=Pre T2025.03 | 0.41 | — | — | — | — | — | — | — | — | — | |
| CEModel=DenseNet, Temperature Scaling=Pre T2025.03 | 0.42 | — | — | — | — | — | — | — | — | — | |
| Ada-TSBackbone=ResNet-56, Alpha=0.05, Nonconformity score=MSP2025.05 | — | — | — | — | 2.37 | 0.448 | 15.04 | 29.45 | 1.95 | 8.75 |