Post-hoc Calibration on CIFAR-10 5000-sample half seed 42 (test)
0.0075ECEBBQ
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BBQBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0075 | 0.0127 | 0.324 | 0.15 | 0.0153 | 0 | |
| Conf + PredEntropyBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0085 | 0.009 | 0.299 | 0.146 | 0.0168 | 0 | |
| Vector ScalingBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0094 | 0.0106 | 0.288 | 0.142 | 0.0169 | 24 | |
| Classwise TSBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0098 | 0.0115 | 0.294 | 0.145 | 0.0182 | 0 | |
| Histogram BinningBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.01 | 0.0099 | 0.323 | 0.15 | 0.0206 | 1 | |
| RCMMCBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.01 | 0.0101 | 0.293 | 0.145 | 0.0195 | 0 | |
| AR-CondCalBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.01 | 0.01 | 0.306 | 0.148 | 0.0194 | 0 | |
| SB-ECE TSBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0105 | 0.0109 | 0.295 | 0.145 | 0.0184 | 0 | |
| Isotonic RegressionBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0108 | 0.0111 | 0.323 | 0.15 | 0.0195 | 1 | |
| Conf-onlyBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0109 | 0.0099 | 0.299 | 0.146 | 0.018 | 0 | |
| Temp. Scaling (TS)Backbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0111 | 0.0123 | 0.295 | 0.146 | 0.0198 | 0 | |
| Ensemble TSBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0111 | 0.0123 | 0.295 | 0.146 | 0.0198 | 0 | |
| Parametric TSBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.0113 | 0.0094 | 0.298 | 0.146 | 0.0179 | 0 | |
| No calibrationBackbone=Swin-Tiny, Epochs=299, Training seeds=3, Split seed=422026.05 | 0.1514 | 0.1514 | 0.427 | 0.175 | 0.1581 | 0 |