Image Classification on CIFAR-10 LT (Accuracy and Calibration)
91.17Top-1 AccuracyRefCal + LS
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RefCal + LSBackbone=ResNet-502026.05 | 91.17 | 99.28 | 4.84 | 1.03 | 0.7 | 4.55 | |
| LS + RefCalBackbone=ResNet-502026.05 | 91.17 | 99.28 | 4.84 | 1.03 | 0.7 | 4.55 | |
| RefCal + MbLSBackbone=ResNet-502026.05 | 91.16 | 99.28 | 5.52 | 1.16 | 0.78 | 5.09 | |
| MbLS + RefCalBackbone=ResNet-502026.05 | 91.16 | 99.28 | 5.52 | 1.16 | 0.78 | 5.09 | |
| RefCal + MMCEBackbone=ResNet-502026.05 | 90.02 | 98.88 | 9.71 | 1.84 | 1.22 | 5.62 | |
| MMCE + RefCalBackbone=ResNet-502026.05 | 90.02 | 98.88 | 9.71 | 1.84 | 1.22 | 5.62 | |
| RefCal + NLL (CE)Backbone=ResNet-502026.05 | 89.7 | 98.82 | 8.6 | 1.83 | 1.45 | 6.85 | |
| RefCal + CE+TSBackbone=ResNet-502026.05 | 89.7 | 99.12 | 3.09 | 1.04 | 1.01 | 2.96 | |
| RefCal + CRLBackbone=ResNet-502026.05 | 89.7 | 98.82 | 8.59 | 1.83 | 1.45 | 6.85 | |
| NLL (CE) + RefCalBackbone=ResNet-502026.05 | 89.7 | 98.82 | 8.6 | 1.83 | 1.45 | 6.85 | |
| CE+TS + RefCalBackbone=ResNet-502026.05 | 89.7 | 99.12 | 3.09 | 1.04 | 1.01 | 2.96 | |
| CRL + RefCalBackbone=ResNet-502026.05 | 89.7 | 98.82 | 8.59 | 1.83 | 1.45 | 6.85 | |
| RefCal + AdaFocalBackbone=ResNet-502026.05 | 89.57 | 98.49 | 10.43 | 1.06 | 1.02 | 5.27 | |
| AdaFocal + RefCalBackbone=ResNet-502026.05 | 89.57 | 98.49 | 10.43 | 1.06 | 1.02 | 5.27 | |
| RefCal + MixUpBackbone=ResNet-502026.05 | 89.49 | 98.69 | 10.16 | 2.54 | 2.42 | 7.42 | |
| MixUp + RefCalBackbone=ResNet-502026.05 | 89.49 | 98.69 | 10.16 | 2.54 | 2.42 | 7.42 | |
| RefCal + AUCMBackbone=ResNet-502026.05 | 89.39 | 99.1 | 5.41 | 1.91 | 1.89 | 5.41 | |
| AUCM + RefCalBackbone=ResNet-502026.05 | 89.39 | 99.1 | 5.41 | 1.91 | 1.89 | 5.41 | |
| RefCal + FL+ MDCABackbone=ResNet-502026.05 | 89.12 | 99.11 | 3.16 | 1.36 | 1.28 | 3.14 | |
| FL+ MDCA + RefCalBackbone=ResNet-502026.05 | 89.12 | 99.11 | 3.16 | 1.36 | 1.28 | 3.14 | |
| RefCal + LogitNormBackbone=ResNet-502026.05 | 89.02 | 98.5 | 74.19 | 10.24 | 15.03 | 50.29 | |
| LogitNorm + RefCalBackbone=ResNet-502026.05 | 89.02 | 98.5 | 74.19 | 10.24 | 15.03 | 50.29 | |
| MixUpBackbone=ResNet-502026.05 | 88.92 | 98.75 | 7.97 | 2.54 | 2.5 | 7.51 | |
| MixUpBackbone=ResNet-502026.05 | 88.92 | 98.75 | 7.97 | 2.54 | 2.5 | 7.51 | |
| AUCMBackbone=ResNet-502026.05 | 88.35 | 98.62 | 5.75 | 1.38 | 1.11 | 5.79 | |
| AUCMBackbone=ResNet-502026.05 | 88.35 | 98.62 | 5.75 | 1.38 | 1.11 | 5.79 | |
| MbLSBackbone=ResNet-502026.05 | 87.82 | 98.59 | 7.05 | 1.58 | 1.24 | 7.05 | |
| MbLSBackbone=ResNet-502026.05 | 87.82 | 98.59 | 7.05 | 1.58 | 1.24 | 7.05 | |
| FL+ MDCABackbone=ResNet-502026.05 | 87.6 | 98.41 | 5.45 | 1.42 | 1.28 | 5.4 | |
| FL+ MDCABackbone=ResNet-502026.05 | 87.6 | 98.41 | 5.45 | 1.42 | 1.28 | 5.4 | |
| LogitNormBackbone=ResNet-502026.05 | 87.13 | 99.02 | 3.14 | 1.31 | 1.21 | 3.11 | |
| LogitNormBackbone=ResNet-502026.05 | 87.13 | 99.02 | 3.14 | 1.31 | 1.21 | 3.11 | |
| LSBackbone=ResNet-502026.05 | 86.58 | 97.33 | 5 | 1.47 | 1.64 | 3.92 | |
| LSBackbone=ResNet-502026.05 | 86.58 | 97.33 | 5 | 1.47 | 1.64 | 3.92 | |
| MMCEBackbone=ResNet-502026.05 | 86.47 | 98.55 | 9.3 | 2.08 | 1.85 | 8.47 | |
| MMCEBackbone=ResNet-502026.05 | 86.47 | 98.55 | 9.3 | 2.08 | 1.85 | 8.47 | |
| NLL (CE)Backbone=ResNet-502026.05 | 85.3 | 98.4 | 9.35 | 2.22 | 2.02 | 8.91 | |
| CE+TSBackbone=ResNet-502026.05 | 85.3 | 98.9 | 3.42 | 1.84 | 1.86 | 3.41 | |
| NLL (CE)Backbone=ResNet-502026.05 | 85.3 | 98.4 | 9.35 | 2.22 | 2.02 | 8.91 | |
| CE+TSBackbone=ResNet-502026.05 | 85.3 | 98.9 | 3.42 | 1.84 | 1.86 | 3.41 | |
| CRLBackbone=ResNet-502026.05 | 83.16 | 97.71 | 10.9 | 2.33 | 2.08 | 10.41 | |
| CRLBackbone=ResNet-502026.05 | 83.16 | 97.71 | 10.9 | 2.33 | 2.08 | 10.41 | |
| AdaFocalBackbone=ResNet-502026.05 | 81.51 | 98.3 | 11.26 | 2.54 | 2.35 | 11.05 | |
| AdaFocalBackbone=ResNet-502026.05 | 81.51 | 98.3 | 11.26 | 2.54 | 2.35 | 11.05 |