List your company
ResearchFormerly WizWand

Calibration on CIFAR-10H

0.84ECEP+L (Recalibrated)
0.66441.84973.0354.2203Sep 29, 2021
Updated 8mo ago

Evaluation results

MethodLinks
P+L (Recalibrated)Backbone=ResNet-164, Fitting Datapoints=5000, Recalibration Datapoints=50002021.090.840.140.08
P+L (Recalibrated)Backbone=ResNet-110, Fitting Datapoints=5000, Recalibration Datapoints=50002021.090.850.190.12
P+L (Recalibrated)Backbone=DenseNet-BC, Fitting Datapoints=5000, Recalibration Datapoints=50002021.090.950.10.07
P+L (Recalibrated)Backbone=PreResNet-164, Fitting Datapoints=5000, Recalibration Datapoints=50002021.091.060.120.08
P+LBackbone=ResNet-164, Fitting Datapoints=102021.091.250.150.1
P+LCalibration Datapoints=10, Backbone=ResNet-164, Prediction Source=Classifier + Human2021.091.250.150.1
P+LBackbone=DenseNet-BC, Fitting Datapoints=50002021.091.270.110.08
P+LCalibration Datapoints=5000, Backbone=DenseNet-BC, Prediction Source=Classifier + Human2021.091.270.110.08
P+LBackbone=ResNet-110, Fitting Datapoints=102021.091.30.240.15
P+LCalibration Datapoints=10, Backbone=ResNet-110, Prediction Source=Classifier + Human2021.091.30.240.15
P+LBackbone=DenseNet-BC, Fitting Datapoints=102021.091.340.120.09
P+LCalibration Datapoints=10, Backbone=DenseNet-BC, Prediction Source=Classifier + Human2021.091.340.120.09
P+LBackbone=ResNet-164, Fitting Datapoints=50002021.091.390.130.1
P+LCalibration Datapoints=5000, Backbone=ResNet-164, Prediction Source=Classifier + Human2021.091.390.130.1
P+LBackbone=PreResNet-164, Fitting Datapoints=102021.091.40.130.11
P+LCalibration Datapoints=10, Backbone=PreResNet-164, Prediction Source=Classifier + Human2021.091.40.130.11
P+LBackbone=PreResNet-164, Fitting Datapoints=50002021.091.430.130.11
P+LCalibration Datapoints=5000, Backbone=PreResNet-164, Prediction Source=Classifier + Human2021.091.430.130.1
P+LBackbone=DenseNet-BC, Fitting Datapoints=None2021.091.530.110.1
P+LCalibration Datapoints=0, Backbone=DenseNet-BC, Prediction Source=Classifier + Human2021.091.530.110.1
P+LBackbone=ResNet-164, Fitting Datapoints=None2021.091.630.150.11
P+LCalibration Datapoints=0, Backbone=ResNet-164, Prediction Source=Classifier + Human2021.091.630.150.11
DenseNet-BCCalibration=Temperature Scaling, Calibration Datapoints=50002021.091.730.240.14
DenseNet-BCCalibration Datapoints=5000, Architecture=DenseNet-BC, Prediction Source=Classifier Only2021.091.730.240.14
P+LBackbone=ResNet-110, Fitting Datapoints=50002021.091.760.190.11
DenseNet-BCCalibration=Temperature Scaling, Calibration Datapoints=102021.091.760.240.14
DenseNet-BCCalibration Datapoints=10, Architecture=DenseNet-BC, Prediction Source=Classifier Only2021.091.760.240.14
P+LCalibration Datapoints=5000, Backbone=ResNet-110, Prediction Source=Classifier + Human2021.091.760.190.14
P+LBackbone=PreResNet-164, Fitting Datapoints=None2021.091.870.130.13
P+LCalibration Datapoints=0, Backbone=PreResNet-164, Prediction Source=Classifier + Human2021.091.870.130.13
ResNet-164Calibration=Temperature Scaling, Calibration Datapoints=50002021.091.890.310.2
ResNet-164Calibration Datapoints=5000, Architecture=ResNet-164, Prediction Source=Classifier Only2021.091.890.310.2
ResNet-164Calibration=Temperature Scaling, Calibration Datapoints=102021.091.950.310.2
ResNet-164Calibration Datapoints=10, Architecture=ResNet-164, Prediction Source=Classifier Only2021.091.950.310.2
P+LBackbone=ResNet-110, Fitting Datapoints=None2021.092.080.230.16
P+LCalibration Datapoints=0, Backbone=ResNet-110, Prediction Source=Classifier + Human2021.092.080.230.16
DenseNet-BCCalibration=None2021.092.180.230.17
DenseNet-BCCalibration Datapoints=0, Architecture=DenseNet-BC, Prediction Source=Classifier Only2021.092.180.230.17
PreResNet-164Calibration=Temperature Scaling, Calibration Datapoints=50002021.092.270.280.19
PreResNet-164Calibration Datapoints=5000, Architecture=PreResNet-164, Prediction Source=Classifier Only2021.092.270.280.19
PreResNet-164Calibration=Temperature Scaling, Calibration Datapoints=102021.092.310.280.19
PreResNet-164Calibration Datapoints=10, Architecture=PreResNet-164, Prediction Source=Classifier Only2021.092.310.280.19
ResNet-164Calibration=None2021.092.980.390.24
ResNet-164Calibration Datapoints=0, Architecture=ResNet-164, Prediction Source=Classifier Only2021.092.980.390.24
ResNet-110Calibration=Temperature Scaling, Calibration Datapoints=50002021.092.990.580.35
ResNet-110Calibration Datapoints=5000, Architecture=ResNet-110, Prediction Source=Classifier Only2021.092.990.580.35
ResNet-110Calibration=Temperature Scaling, Calibration Datapoints=102021.093.030.580.35
PreResNet-164Calibration=None2021.093.030.290.23
PreResNet-164Calibration Datapoints=0, Architecture=PreResNet-164, Prediction Source=Classifier Only2021.093.030.290.23
ResNet-110Calibration Datapoints=10, Architecture=ResNet-110, Prediction Source=Classifier Only2021.093.030.580.35
ResNet-110Calibration=None2021.095.230.810.4
ResNet-110Calibration Datapoints=0, Architecture=ResNet-110, Prediction Source=Classifier Only2021.095.230.810.4