Model Calibration on Tiny ImageNet
0.82Expected Calibration ErrorBrier Loss
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Brier LossModel=ResNet-502026.04 | 0.82 | — | — | — | — | — | 3.89 | — | — | |
| AFLModel=ResNet-502026.04 | 0.83 | — | — | — | — | — | 2.69 | — | — | |
| FLSDModel=ResNet-502026.04 | 0.94 | — | — | — | — | — | 1.82 | — | — | |
| AFLModel=ResNet-1102026.04 | 0.97 | — | — | — | — | — | 2.74 | — | — | |
| DFLModel=ResNet-502026.04 | 1.02 | — | — | — | — | — | 2.66 | — | — | |
| FLSDModel=ResNet-1102026.04 | 1.03 | — | — | — | — | — | 2.22 | — | — | |
| DFLModel=ResNet-1102026.04 | 1.04 | — | — | — | — | — | 2.55 | — | — | |
| GCEModel=ResNet-1102026.04 | 1.15 | — | — | — | — | — | 4.2 | — | — | |
| GCEModel=ResNet-502026.04 | 1.19 | — | — | — | — | — | 4.29 | — | — | |
| BalCALBackbone=ResNet-1012025.04 | 1.35 | — | — | — | 66.9 | 1.48 | — | — | — | |
| FLSDBackbone=ResNet-1012025.04 | 1.39 | — | — | — | 63.09 | 1.65 | — | — | — | |
| BalCALBackbone=ResNet-502025.04 | 1.4 | — | — | — | 65.22 | 1.47 | — | — | — | |
| MITBackbone=ResNet-502025.04 | 1.45 | — | — | — | 64.27 | 1.32 | — | — | — | |
| Brier LossModel=ResNet-1102026.04 | 1.5 | — | — | — | — | — | 4.15 | — | — | |
| MITBackbone=ResNet-1012025.04 | 1.58 | — | — | — | 66.81 | 1.64 | — | — | — | |
| LSBackbone=ResNet-502025.04 | 1.59 | — | — | — | 63.1 | 1.71 | — | — | — | |
| CEModel=ResNet-502026.04 | 1.59 | — | — | — | — | — | 16.52 | — | — | |
| MMCEModel=ResNet-1102026.04 | 1.61 | — | — | — | — | — | 16.25 | — | — | |
| CEModel=ResNet-1102026.04 | 1.62 | — | — | — | — | — | 16.07 | — | — | |
| MMCEModel=ResNet-502026.04 | 1.66 | — | — | — | — | — | 14.88 | — | — | |
| FLSDBackbone=ResNet-502025.04 | 1.84 | — | — | — | 63.09 | 1.84 | — | — | — | |
| LSBackbone=ResNet-1012025.04 | 1.93 | — | — | — | 63.12 | 6.25 | — | — | — | |
| FLBackbone=ResNet-502025.04 | 2.07 | — | — | — | 62.82 | 2.05 | — | — | — | |
| AlignmixupBackbone=ResNet18, Training=from scratch2026.06 | 2.18 | — | — | — | — | — | — | 6.13 | 1.98 | |
| OA-CutMix/absBackbone=DeiT-Ti, latency [ms]=1.012026.06 | 2.31 | — | — | — | — | — | — | 3.27 | — | |
| VanillaBackbone=ResNet-1012025.04 | 2.5 | — | — | — | 62.05 | 2.44 | — | — | — | |
| FLBackbone=ResNet-1012025.04 | 2.57 | — | — | — | 62.37 | 7.76 | — | — | — | |
| OA-CutMix/abs + decoupledBackbone=DeiT-Ti, latency [ms]=1.012026.06 | 2.84 | — | — | — | — | — | — | 3.66 | — | |
| VTSTBackbone=ResNet-1012025.04 | 2.91 | — | — | — | 60.85 | 2.88 | — | — | — | |
| OA-CutMix/absBackbone=ResNet18, Training=from scratch2026.06 | 3.11 | — | — | — | — | — | — | 4.27 | 1.05 | |
| OA-CutMix/abs + decoupledBackbone=ResNet18, Training=from scratch2026.06 | 3.14 | — | — | — | — | — | — | 4.85 | 1.01 | |
| OA-CutMix/rel + decoupledBackbone=ResNet18, Training=from scratch2026.06 | 3.18 | — | — | — | — | — | — | 4.66 | 1 | |
| Mixup+CutMixBackbone=ResNet50, Training=from scratch2026.06 | 3.44 | — | — | — | — | — | — | 12.25 | 0.67 | |
| OA-CutMix/relBackbone=ResNet18, Training=from scratch2026.06 | 3.49 | — | — | — | — | — | — | 4.76 | 1.02 | |
| OA-CutMix/relBackbone=DeiT-Ti, latency [ms]=1.032026.06 | 3.6 | — | — | — | — | — | — | 3.96 | — | |
| PuzzleMixBackbone=DeiT-S, latency [ms]=273.282026.06 | 3.81 | — | — | — | — | — | — | 6.1 | — | |
| mixupBackbone=ResNet-502025.04 | 3.85 | — | — | — | 65.88 | 3.84 | — | — | — | |
| CutMix + decoupledBackbone=DeiT-Ti, latency [ms]=0.672026.06 | 3.88 | — | — | — | — | — | — | 4.71 | — | |
| mixupBackbone=ResNet-1012025.04 | 3.98 | — | — | — | 66.56 | 3.86 | — | — | — | |
| OA-CutMix/rel + decoupledBackbone=DeiT-Ti, latency [ms]=1.112026.06 | 3.99 | — | — | — | — | — | — | 4.6 | — | |
| MixupBackbone=DeiT-Ti, latency [ms]=0.732026.06 | 4.02 | — | — | — | — | — | — | 6.03 | — | |
| Mixup + CutMixBackbone=DeiT-Ti, latency [ms]=0.702026.06 | 4.08 | — | — | — | — | — | — | 7.41 | — | |
| PuzzleMixBackbone=DeiT-Ti, latency [ms]=273.282026.06 | 4.13 | — | — | — | — | — | — | 6.1 | — | |
| OA-CutMix/absBackbone=ResNet50, Training=from scratch2026.06 | 4.19 | — | — | — | — | — | — | 4.27 | 1.05 | |
| VanillaBackbone=ResNet-502025.04 | 4.38 | — | — | — | 60.53 | 4.37 | — | — | — | |
| TokenMixBackbone=DeiT-S, latency [ms]=39.912026.06 | 4.45 | — | — | — | — | — | — | 7.52 | — | |
| SnapMixBackbone=DeiT-Ti, latency [ms]=39.982026.06 | 4.69 | — | — | — | — | — | — | 10.15 | — | |
| PuzzleMixBackbone=ResNet50, Training=from scratch2026.06 | 5.11 | — | — | — | — | — | — | 8.82 | 301 | |
| CutMixBackbone=ResNet50, Training=from scratch2026.06 | 5.26 | — | — | — | — | — | — | 9.08 | 0.61 | |
| Mixup + CutMixBackbone=DeiT-S, latency [ms]=0.702026.06 | 5.31 | — | — | — | — | — | — | 7.41 | — | |
| ResizeMixBackbone=ResNet18, Training=from scratch2026.06 | 5.4 | — | — | — | — | — | — | 5.04 | 0.62 | |
| MixupBackbone=DeiT-S, latency [ms]=0.732026.06 | 5.42 | — | — | — | — | — | — | 6.03 | — | |
| FMixBackbone=ResNet50, Training=from scratch2026.06 | 5.44 | — | — | — | — | — | — | 7.65 | 6.68 | |
| CutMix + decoupledBackbone=ResNet50, Training=from scratch2026.06 | 5.48 | — | — | — | — | — | — | 7.42 | 0.6 | |
| OA-CutMix/abs + decoupledBackbone=ResNet50, Training=from scratch2026.06 | 5.58 | — | — | — | — | — | — | 4.85 | 1.01 | |
| CutMixBackbone=DeiT-Ti, latency [ms]=0.672026.06 | 5.61 | — | — | — | — | — | — | 8.75 | — | |
| VTSTBackbone=ResNet-502025.04 | 5.75 | — | — | — | 59.46 | 5.75 | — | — | — | |
| SnapMixBackbone=ResNet50, Training=from scratch2026.06 | 5.82 | — | — | — | — | — | — | 6.17 | 51.49 | |
| Attentive CutMixBackbone=DeiT-Ti, latency [ms]=56.102026.06 | 5.87 | — | — | — | — | — | — | 7.64 | — | |
| CutMixBackbone=DeiT-S, latency [ms]=0.672026.06 | 5.98 | — | — | — | — | — | — | 8.75 | — | |
| MixupBackbone=ResNet50, Training=from scratch2026.06 | 5.99 | — | — | — | — | — | — | 12.18 | 0.73 | |
| TSTBackbone=ResNet-1012025.04 | 6.01 | — | — | — | 61.49 | 6.01 | — | — | — | |
| TSTBackbone=ResNet-502025.04 | 6.18 | — | — | — | 59.96 | 6.18 | — | — | — | |
| CutMix + decoupledBackbone=ResNet18, Training=from scratch2026.06 | 6.47 | — | — | — | — | — | — | 7.42 | 0.6 | |
| SnapMixBackbone=DeiT-S, latency [ms]=39.982026.06 | 6.72 | — | — | — | — | — | — | 10.15 | — | |
| OA-CutMix/relBackbone=ResNet50, Training=from scratch2026.06 | 6.87 | — | — | — | — | — | — | 4.76 | 1.02 | |
| CutMixBackbone=ResNet18, Training=from scratch2026.06 | 6.93 | — | — | — | — | — | — | 9.08 | 0.61 | |
| OA-CutMix/absBackbone=DeiT-S, latency [ms]=1.012026.06 | 6.94 | — | — | — | — | — | — | 3.27 | — | |
| OA-CutMix/rel + decoupledBackbone=ResNet50, Training=from scratch2026.06 | 7.02 | — | — | — | — | — | — | 4.66 | 1 | |
| FMixBackbone=ResNet18, Training=from scratch2026.06 | 7.1 | — | — | — | — | — | — | 7.65 | 6.68 | |
| ResizeMixBackbone=ResNet50, Training=from scratch2026.06 | 7.18 | — | — | — | — | — | — | 5.04 | 0.62 | |
| Attentive CutMixBackbone=ResNet18, Training=from scratch2026.06 | 7.51 | — | — | — | — | — | — | 8.69 | 56.36 | |
| OA-CutMix/abs + decoupledBackbone=DeiT-S, latency [ms]=1.012026.06 | 7.75 | — | — | — | — | — | — | 3.66 | — | |
| TokenMixBackbone=DeiT-Ti, latency [ms]=39.912026.06 | 8.01 | — | — | — | — | — | — | 7.52 | — | |
| Attentive CutMixBackbone=ResNet50, Training=from scratch2026.06 | 8.84 | — | — | — | — | — | — | 8.69 | 56.36 | |
| SnapMixBackbone=ResNet18, Training=from scratch2026.06 | 8.9 | — | — | — | — | — | — | 6.17 | 51.49 | |
| FMixBackbone=DeiT-Ti, latency [ms]=6.802026.06 | 8.91 | — | — | — | — | — | — | 6.91 | — | |
| OA-CutMix/relBackbone=DeiT-S, latency [ms]=1.032026.06 | 9.15 | — | — | — | — | — | — | 3.96 | — | |
| ResizeMixBackbone=DeiT-S, latency [ms]=1.052026.06 | 9.57 | — | — | — | — | — | — | 7.44 | — | |
| PuzzleMixBackbone=ResNet18, Training=from scratch2026.06 | 9.7 | — | — | — | — | — | — | 8.82 | 301 | |
| OA-CutMix/rel + decoupledBackbone=DeiT-S, latency [ms]=1.112026.06 | 10.53 | — | — | — | — | — | — | 4.6 | — | |
| FMixBackbone=DeiT-S, latency [ms]=6.802026.06 | 10.63 | — | — | — | — | — | — | 6.91 | — | |
| ResizeMixBackbone=DeiT-Ti, latency [ms]=1.052026.06 | 11.18 | — | — | — | — | — | — | 7.44 | — | |
| Attentive CutMixBackbone=DeiT-S, latency [ms]=56.102026.06 | 11.74 | — | — | — | — | — | — | 7.64 | — | |
| CutMix + decoupledBackbone=DeiT-S, latency [ms]=0.672026.06 | 13.96 | — | — | — | — | — | — | 4.71 | — | |
| VanillaBackbone=ResNet50, Training=from scratch2026.06 | 15.46 | — | — | — | — | — | — | 9.33 | — | |
| Mixup+CutMixBackbone=ResNet18, Training=from scratch2026.06 | 16.3 | — | — | — | — | — | — | 12.25 | 0.67 | |
| MixupBackbone=ResNet18, Training=from scratch2026.06 | 16.62 | — | — | — | — | — | — | 12.18 | 0.73 | |
| VanillaBackbone=DeiT-Ti2026.06 | 17.01 | — | — | — | — | — | — | 14.78 | — | |
| VanillaBackbone=ResNet18, Training=from scratch2026.06 | 18.26 | — | — | — | — | — | — | 9.33 | — | |
| AlignmixupBackbone=ResNet50, Training=from scratch2026.06 | 20.81 | — | — | — | — | — | — | 6.13 | 1.98 | |
| VanillaBackbone=DeiT-S2026.06 | 30.36 | — | — | — | — | — | — | 14.78 | — | |
| Softmax Temperature TuningTemperature Tuning=true, Outlier Exposure=false2018.12 | — | 12 | 9 | 62.9 | — | — | — | — | — | |
| Softmax Temperature Tuning + OETemperature Tuning=true, Outlier Exposure=true2018.12 | — | 6.9 | 4.8 | 72.2 | — | — | — | — | — |