Label shift estimation on MNIST Dirichlet shift alpha=10 (val size=500)
0.6MSE (10^-3)CC
Evaluation results
| Method | Links | |
|---|---|---|
| CCShift Estimator=CC, Calibration Method=None2026.04 | 0.6 | |
| LEIPShift Estimator=LEIP, Calibration Method=VS2026.04 | 2.92 | |
| LEIPShift Estimator=LEIP, Calibration Method=BCTS2026.04 | 3.02 | |
| EMShift Estimator=EM, Calibration Method=VS2026.04 | 3.57 | |
| LEIPShift Estimator=LEIP, Calibration Method=NBVS2026.04 | 3.59 | |
| RLLSShift Estimator=RLLS, Calibration Method=VS2026.04 | 3.79 | |
| EMShift Estimator=EM, Calibration Method=BCTS2026.04 | 3.99 | |
| RLLSShift Estimator=RLLS, Calibration Method=BCTS2026.04 | 4.32 | |
| RLLSShift Estimator=RLLS, Calibration Method=NBVS2026.04 | 4.73 | |
| EMShift Estimator=EM, Calibration Method=NBVS2026.04 | 4.74 | |
| RLLS-HardShift Estimator=RLLS-Hard, Calibration Method=None2026.04 | 4.89 | |
| RLLSShift Estimator=RLLS, Calibration Method=TS2026.04 | 5.15 | |
| EMShift Estimator=EM, Calibration Method=TS2026.04 | 5.32 | |
| RLLSShift Estimator=RLLS, Calibration Method=None2026.04 | 5.35 | |
| LEIPShift Estimator=LEIP, Calibration Method=TS2026.04 | 5.38 | |
| LEIPShift Estimator=LEIP, Calibration Method=None2026.04 | 5.46 | |
| EMShift Estimator=EM, Calibration Method=None2026.04 | 5.49 |