Label Shift Estimation on CIFAR-10 (val)
0.33MSELEIP
Evaluation Results
| Method | Links | |
|---|---|---|
| LEIPCalibration Method=BCTS, Validation Size=2500, alpha=102026.04 | 0.33 | |
| LEIPCalibration Method=VS, Validation Size=4000, alpha=102026.04 | 0.34 | |
| LEIPCalibration Method=VS, Validation Size=2500, alpha=102026.04 | 0.35 | |
| LEIPCalibration Method=BCTS, Validation Size=4000, alpha=102026.04 | 0.41 | |
| LEIPCalibration Method=VS, Validation Size=2500, alpha=12026.04 | 0.54 | |
| LEIPCalibration Method=BCTS, Validation Size=2500, alpha=12026.04 | 0.57 | |
| LEIPCalibration Method=VS, Validation Size=4000, alpha=12026.04 | 0.59 | |
| LEIPCalibration Method=NBVS, Validation Size=2500, alpha=102026.04 | 0.66 | |
| LEIPCalibration Method=BCTS, Validation Size=4000, alpha=12026.04 | 0.68 | |
| LEIPCalibration Method=TS, Validation Size=4000, alpha=102026.04 | 0.71 | |
| LEIPCalibration Method=NBVS, Validation Size=4000, alpha=102026.04 | 0.73 | |
| LEIPCalibration Method=TS, Validation Size=2500, alpha=102026.04 | 0.74 | |
| EMCalibration Method=VS, Validation Size=4000, alpha=102026.04 | 0.78 | |
| LEIPCalibration Method=VS, Validation Size=2500, alpha=0.12026.04 | 0.78 | |
| RLLSCalibration Method=TS, Validation Size=4000, alpha=102026.04 | 0.79 | |
| RLLSCalibration Method=BCTS, Validation Size=4000, alpha=102026.04 | 0.79 | |
| EMCalibration Method=BCTS, Validation Size=4000, alpha=102026.04 | 0.81 | |
| RLLSCalibration Method=VS, Validation Size=4000, alpha=102026.04 | 0.81 | |
| RLLSCalibration Method=None, Validation Size=4000, alpha=102026.04 | 0.83 | |
| RLLSCalibration Method=BCTS, Validation Size=4000, alpha=12026.04 | 0.83 | |
| EMCalibration Method=NBVS, Validation Size=4000, alpha=102026.04 | 0.83 | |
| EMCalibration Method=TS, Validation Size=4000, alpha=102026.04 | 0.84 | |
| RLLSCalibration Method=NBVS, Validation Size=4000, alpha=102026.04 | 0.84 | |
| EMCalibration Method=BCTS, Validation Size=4000, alpha=12026.04 | 0.87 | |
| LEIPCalibration Method=None, Validation Size=4000, alpha=102026.04 | 0.89 | |
| EMCalibration Method=VS, Validation Size=2500, alpha=0.12026.04 | 0.89 | |
| LEIPCalibration Method=VS, Validation Size=4000, alpha=0.12026.04 | 0.96 | |
| EMCalibration Method=VS, Validation Size=4000, alpha=12026.04 | 0.97 | |
| EMCalibration Method=None, Validation Size=4000, alpha=102026.04 | 1.03 | |
| EMCalibration Method=VS, Validation Size=4000, alpha=0.12026.04 | 1.03 | |
| EMCalibration Method=VS, Validation Size=2500, alpha=102026.04 | 1.03 | |
| LEIPCalibration Method=None, Validation Size=2500, alpha=102026.04 | 1.08 | |
| EMCalibration Method=NBVS, Validation Size=2500, alpha=102026.04 | 1.08 | |
| RLLS-HardCalibration Method=None, Validation Size=4000, alpha=102026.04 | 1.1 | |
| EMCalibration Method=VS, Validation Size=2500, alpha=12026.04 | 1.12 | |
| RLLS-HardCalibration Method=None, Validation Size=2500, alpha=102026.04 | 1.15 | |
| EMCalibration Method=BCTS, Validation Size=2500, alpha=102026.04 | 1.15 | |
| RLLSCalibration Method=TS, Validation Size=4000, alpha=12026.04 | 1.18 | |
| RLLSCalibration Method=None, Validation Size=4000, alpha=12026.04 | 1.22 | |
| RLLSCalibration Method=VS, Validation Size=4000, alpha=12026.04 | 1.22 | |
| EMCalibration Method=BCTS, Validation Size=2500, alpha=12026.04 | 1.23 | |
| RLLSCalibration Method=NBVS, Validation Size=4000, alpha=12026.04 | 1.23 | |
| EMCalibration Method=NBVS, Validation Size=4000, alpha=12026.04 | 1.23 | |
| RLLSCalibration Method=VS, Validation Size=2500, alpha=102026.04 | 1.26 | |
| CCCalibration Method=None, Validation Size=4000, alpha=102026.04 | 1.29 | |
| CCCalibration Method=None, Validation Size=2500, alpha=102026.04 | 1.3 | |
| RLLSCalibration Method=NBVS, Validation Size=2500, alpha=102026.04 | 1.32 | |
| LEIPCalibration Method=TS, Validation Size=4000, alpha=12026.04 | 1.33 | |
| RLLSCalibration Method=BCTS, Validation Size=2500, alpha=102026.04 | 1.38 | |
| EMCalibration Method=TS, Validation Size=2500, alpha=102026.04 | 1.39 | |
| LEIPCalibration Method=TS, Validation Size=2500, alpha=12026.04 | 1.4 | |
| LEIPCalibration Method=NBVS, Validation Size=4000, alpha=12026.04 | 1.4 | |
| CCCalibration Method=None, Validation Size=1000, alpha=102026.04 | 1.41 | |
| EMCalibration Method=None, Validation Size=2500, alpha=102026.04 | 1.45 | |
| RLLSCalibration Method=BCTS, Validation Size=2500, alpha=12026.04 | 1.47 | |
| EMCalibration Method=TS, Validation Size=4000, alpha=12026.04 | 1.49 | |
| LEIPCalibration Method=NBVS, Validation Size=2500, alpha=12026.04 | 1.5 | |
| EMCalibration Method=NBVS, Validation Size=2500, alpha=12026.04 | 1.53 | |
| RLLSCalibration Method=TS, Validation Size=2500, alpha=102026.04 | 1.54 | |
| RLLS-HardCalibration Method=None, Validation Size=4000, alpha=12026.04 | 1.58 | |
| RLLSCalibration Method=None, Validation Size=2500, alpha=102026.04 | 1.62 | |
| RLLS-HardCalibration Method=None, Validation Size=2500, alpha=12026.04 | 2.03 | |
| LEIPCalibration Method=BCTS, Validation Size=2500, alpha=0.12026.04 | 2.07 | |
| EMCalibration Method=TS, Validation Size=2500, alpha=12026.04 | 2.1 | |
| LEIPCalibration Method=BCTS, Validation Size=1000, alpha=102026.04 | 2.12 | |
| RLLSCalibration Method=VS, Validation Size=2500, alpha=12026.04 | 2.17 | |
| LEIPCalibration Method=VS, Validation Size=1000, alpha=102026.04 | 2.2 | |
| RLLSCalibration Method=NBVS, Validation Size=2500, alpha=12026.04 | 2.24 | |
| LEIPCalibration Method=BCTS, Validation Size=1000, alpha=12026.04 | 2.28 | |
| LEIPCalibration Method=VS, Validation Size=1000, alpha=0.12026.04 | 2.32 | |
| LEIPCalibration Method=BCTS, Validation Size=4000, alpha=0.12026.04 | 2.39 | |
| LEIPCalibration Method=None, Validation Size=4000, alpha=12026.04 | 2.43 | |
| RLLSCalibration Method=TS, Validation Size=2500, alpha=12026.04 | 2.45 | |
| LEIPCalibration Method=VS, Validation Size=1000, alpha=12026.04 | 2.54 | |
| RLLSCalibration Method=None, Validation Size=2500, alpha=12026.04 | 2.55 | |
| RLLSCalibration Method=None, Validation Size=4000, alpha=0.12026.04 | 2.6 | |
| RLLS-HardCalibration Method=None, Validation Size=4000, alpha=0.12026.04 | 2.61 | |
| LEIPCalibration Method=None, Validation Size=1000, alpha=102026.04 | 2.65 | |
| RLLS-HardCalibration Method=None, Validation Size=1000, alpha=102026.04 | 2.66 | |
| RLLSCalibration Method=TS, Validation Size=4000, alpha=0.12026.04 | 2.7 | |
| EMCalibration Method=None, Validation Size=4000, alpha=12026.04 | 2.73 | |
| RLLSCalibration Method=NBVS, Validation Size=4000, alpha=0.12026.04 | 2.74 | |
| RLLSCalibration Method=BCTS, Validation Size=4000, alpha=0.12026.04 | 2.78 | |
| EMCalibration Method=BCTS, Validation Size=4000, alpha=0.12026.04 | 2.81 | |
| RLLSCalibration Method=VS, Validation Size=4000, alpha=0.12026.04 | 2.81 | |
| LEIPCalibration Method=None, Validation Size=2500, alpha=12026.04 | 2.83 | |
| EMCalibration Method=VS, Validation Size=1000, alpha=0.12026.04 | 2.83 | |
| LEIPCalibration Method=NBVS, Validation Size=4000, alpha=0.12026.04 | 2.93 | |
| EMCalibration Method=None, Validation Size=1000, alpha=102026.04 | 3.01 | |
| EMCalibration Method=NBVS, Validation Size=4000, alpha=0.12026.04 | 3.07 | |
| EMCalibration Method=BCTS, Validation Size=2500, alpha=0.12026.04 | 3.16 | |
| LEIPCalibration Method=TS, Validation Size=1000, alpha=102026.04 | 3.25 | |
| LEIPCalibration Method=NBVS, Validation Size=2500, alpha=0.12026.04 | 3.25 | |
| LEIPCalibration Method=NBVS, Validation Size=1000, alpha=102026.04 | 3.35 | |
| EMCalibration Method=None, Validation Size=2500, alpha=12026.04 | 3.37 | |
| RLLSCalibration Method=None, Validation Size=1000, alpha=102026.04 | 3.38 | |
| EMCalibration Method=NBVS, Validation Size=2500, alpha=0.12026.04 | 3.57 | |
| EMCalibration Method=BCTS, Validation Size=1000, alpha=12026.04 | 3.72 | |
| LEIPCalibration Method=BCTS, Validation Size=1000, alpha=0.12026.04 | 3.83 | |
| RLLS-HardCalibration Method=None, Validation Size=2500, alpha=0.12026.04 | 3.85 |