Classwise Calibration on CIFAR-10 LT
1.07Average Classwise ECEGCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GCErho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.07 | 1.61 | |
| CErho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.08 | 1.65 | |
| MMCErho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.08 | 1.64 | |
| Brier Lossrho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.12 | 1.22 | |
| Brier Lossrho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.12 | 1.25 | |
| DFLrho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.14 | 1.26 | |
| GCErho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.15 | 1.8 | |
| FLSDrho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.16 | 1.18 | |
| GCErho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.2 | 1.83 | |
| CErho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.21 | 1.84 | |
| DFLrho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.21 | 1.43 | |
| MMCErho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.22 | 1.91 | |
| GCErho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.22 | 1.89 | |
| CErho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.23 | 1.92 | |
| MMCErho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.23 | 1.79 | |
| CErho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.24 | 1.87 | |
| Brier Lossrho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.24 | 1.43 | |
| Brier Lossrho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.24 | 1.48 | |
| MMCErho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.28 | 1.86 | |
| DFLrho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.28 | 1.61 | |
| FLSDrho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.3 | 1.37 | |
| DFLrho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.31 | 1.58 | |
| AFLrho (Imbalance ratio)=10, Backbone=DenseNet1212026.04 | 1.31 | 1.34 | |
| FLSDrho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.34 | 1.49 | |
| AFLrho (Imbalance ratio)=10, Backbone=ResNet-502026.04 | 1.36 | 1.38 | |
| FLSDrho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.39 | 1.53 | |
| AFLrho (Imbalance ratio)=10, Backbone=Wide-ResNet2026.04 | 1.39 | 1.4 | |
| AFLrho (Imbalance ratio)=10, Backbone=ResNet-1102026.04 | 1.42 | 1.44 | |
| GCErho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 3.19 | 4.36 | |
| GCErho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 3.37 | 4.35 | |
| Brier Lossrho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 3.41 | 3.93 | |
| GCErho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 3.45 | 4.83 | |
| GCErho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 3.46 | 4.73 | |
| CErho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 3.59 | 4.83 | |
| MMCErho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 3.59 | 4.85 | |
| MMCErho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 3.64 | 4.67 | |
| CErho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 3.71 | 4.67 | |
| MMCErho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 3.74 | 4.99 | |
| CErho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 3.75 | 5.1 | |
| MMCErho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 3.75 | 5.06 | |
| Brier Lossrho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 3.75 | 4.26 | |
| CErho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 3.76 | 5 | |
| DFLrho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 3.76 | 4.38 | |
| DFLrho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 3.86 | 4.68 | |
| DFLrho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 3.88 | 4.61 | |
| Brier Lossrho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 3.89 | 4.73 | |
| DFLrho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 3.9 | 4.3 | |
| Brier Lossrho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 3.95 | 4.69 | |
| FLSDrho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 4.01 | 4.32 | |
| FLSDrho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 4.15 | 4.73 | |
| FLSDrho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 4.18 | 4.4 | |
| FLSDrho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 4.2 | 4.74 | |
| AFLrho (Imbalance ratio)=100, Backbone=DenseNet1212026.04 | 4.31 | 4.37 | |
| AFLrho (Imbalance ratio)=100, Backbone=ResNet-1102026.04 | 4.51 | 4.54 | |
| AFLrho (Imbalance ratio)=100, Backbone=Wide-ResNet2026.04 | 4.52 | 4.55 | |
| AFLrho (Imbalance ratio)=100, Backbone=ResNet-502026.04 | 4.54 | 4.58 |