Model Calibration on SVHN
0.24ECEBalCAL
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BalCALBackbone=WRN-28-102025.04 | 0.24 | — | — | — | 95.47 | 0.33 | |
| TSTBackbone=WRN-28-102025.04 | 0.43 | — | — | — | 95.1 | — | |
| VTSTBackbone=WRN-28-102025.04 | 0.48 | — | — | — | 94.73 | — | |
| MITBackbone=WRN-28-102025.04 | 0.78 | — | — | — | 93.69 | 0.68 | |
| FLSDBackbone=WRN-28-102025.04 | 1.03 | — | — | — | 94.6 | 0.92 | |
| FLBackbone=WRN-28-102025.04 | 1.24 | — | — | — | 94.79 | 1.26 | |
| CPCBackbone=WRN-28-102025.04 | 1.61 | — | — | — | 94.73 | 1.45 | |
| MMCEBackbone=WRN-28-102025.04 | 2.3 | — | — | — | 93.99 | 2.31 | |
| BaseIF=502023.04 | 2.32 | — | — | — | — | — | |
| GPCIF=502023.04 | 2.32 | — | — | — | — | — | |
| IROVAIF=502023.04 | 2.63 | — | — | — | — | — | |
| ACLSBackbone=WRN-28-102025.04 | 3.2 | — | — | — | 95.33 | 3.19 | |
| VanillaBackbone=WRN-28-102025.04 | 3.32 | — | — | — | 95.12 | 3.31 | |
| ETSIF=502023.04 | 3.33 | — | — | — | — | — | |
| PLPBackbone=WRN-28-102025.04 | 3.49 | — | — | — | 95.07 | 3.49 | |
| MixupBackbone=WRN-28-102025.04 | 3.75 | — | — | — | 94.82 | 3.57 | |
| LSBackbone=WRN-28-102025.04 | 3.77 | — | — | — | 95.5 | 3.93 | |
| TSIF=502023.04 | 3.95 | — | — | — | — | — | |
| IRIF=102023.04 | 4.51 | — | — | — | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=502023.04 | 4.53 | — | — | — | — | — | |
| IROVAIF=102023.04 | 5.31 | — | — | — | — | — | |
| GPCIF=102023.04 | 5.31 | — | — | — | — | — | |
| BaseIF=102023.04 | 5.75 | — | — | — | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=1002023.04 | 6.09 | — | — | — | — | — | |
| TSIF=102023.04 | 6.76 | — | — | — | — | — | |
| ETSIF=102023.04 | 6.94 | — | — | — | — | — | |
| SBCIF=102023.04 | 7 | — | — | — | — | — | |
| TSIF=1002023.04 | 7.2 | — | — | — | — | — | |
| Knowledge-Transferring-based Temperature ScalingIF=102023.04 | 7.43 | — | — | — | — | — | |
| TS-IRIF=102023.04 | 8.1 | — | — | — | — | — | |
| SBCIF=502023.04 | 9.43 | — | — | — | — | — | |
| SBCIF=1002023.04 | 9.59 | — | — | — | — | — | |
| TS-IRIF=502023.04 | 11.42 | — | — | — | — | — | |
| ETSIF=1002023.04 | 11.62 | — | — | — | — | — | |
| IRIF=502023.04 | 12.15 | — | — | — | — | — | |
| GPCIF=1002023.04 | 13.67 | — | — | — | — | — | |
| IROVAIF=1002023.04 | 14.93 | — | — | — | — | — | |
| BaseIF=1002023.04 | 16.06 | — | — | — | — | — | |
| TS-IRIF=1002023.04 | 21.25 | — | — | — | — | — | |
| IRIF=1002023.04 | 22.18 | — | — | — | — | — | |
| Softmax Temperature TuningTemperature Tuning=true, Outlier Exposure=false2018.12 | — | 22.3 | 10.9 | 52.1 | — | — | |
| Softmax Temperature Tuning + OETemperature Tuning=true, Outlier Exposure=true2018.12 | — | 4.8 | 2.4 | 87.9 | — | — |