Label shift estimation on MNIST Dirichlet shift alpha=1 (val)
0.44MSE (10^-3)LEIP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LEIPShift Estimator=LEIP, Calibration Method=BCTS2026.04 | 0.44 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=NBVS2026.04 | 0.44 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=BCTS2026.04 | 0.46 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=VS2026.04 | 0.46 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=NBVS2026.04 | 0.55 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=VS2026.04 | 0.55 | — | |
| EMShift Estimator=EM, Calibration Method=NBVS2026.04 | 0.61 | — | |
| EMShift Estimator=EM, Calibration Method=NBVS2026.04 | 0.62 | — | |
| EMShift Estimator=EM, Calibration Method=BCTS2026.04 | 0.63 | — | |
| EMShift Estimator=EM, Calibration Method=VS2026.04 | 0.63 | — | |
| EMShift Estimator=EM, Calibration Method=BCTS2026.04 | 0.64 | — | |
| EMShift Estimator=EM, Calibration Method=VS2026.04 | 0.66 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=None2026.04 | 0.97 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=None2026.04 | 0.97 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=BCTS2026.04 | 1.01 | — | |
| EMShift Estimator=EM, Calibration Method=None2026.04 | 1.03 | — | |
| RLLS-HardShift Estimator=RLLS-Hard, Calibration Method=None2026.04 | 1.04 | — | |
| RLLS-HardShift Estimator=RLLS-Hard, Calibration Method=None2026.04 | 1.06 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=NBVS2026.04 | 1.08 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=VS2026.04 | 1.1 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=None2026.04 | 1.12 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=TS2026.04 | 1.13 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=None2026.04 | 1.14 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=BCTS2026.04 | 1.15 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=VS2026.04 | 1.15 | — | |
| EMShift Estimator=EM, Calibration Method=None2026.04 | 1.16 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=NBVS2026.04 | 1.18 | — | |
| RLLSShift Estimator=RLLS, Calibration Method=TS2026.04 | 1.22 | — | |
| EMShift Estimator=EM, Calibration Method=TS2026.04 | 1.24 | — | |
| EMShift Estimator=EM, Calibration Method=TS2026.04 | 1.39 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=TS2026.04 | 1.49 | — | |
| LEIPShift Estimator=LEIP, Calibration Method=TS2026.04 | 1.57 | — | |
| CCShift Estimator=CC, Calibration Method=None2026.04 | 2.32 | — | |
| CCShift Estimator=CC, Calibration Method=None2026.04 | 2.49 | — | |
| CCShift Estimator=CC, Calibration Method=None2026.04 | — | 2,740 | |
| EMShift Estimator=EM, Calibration Method=None2026.04 | — | 7,920 | |
| EMShift Estimator=EM, Calibration Method=TS2026.04 | — | 7,630 | |
| EMShift Estimator=EM, Calibration Method=BCTS2026.04 | — | 3,600 | |
| EMShift Estimator=EM, Calibration Method=NBVS2026.04 | — | 4,620 | |
| EMShift Estimator=EM, Calibration Method=VS2026.04 | — | 4,160 | |
| LEIPShift Estimator=LEIP, Calibration Method=None2026.04 | — | 8,000 | |
| LEIPShift Estimator=LEIP, Calibration Method=TS2026.04 | — | 8,010 | |
| LEIPShift Estimator=LEIP, Calibration Method=BCTS2026.04 | — | 2,600 | |
| LEIPShift Estimator=LEIP, Calibration Method=NBVS2026.04 | — | 3,430 | |
| LEIPShift Estimator=LEIP, Calibration Method=VS2026.04 | — | 3,370 | |
| RLLSShift Estimator=RLLS, Calibration Method=None2026.04 | — | 7,390 | |
| RLLSShift Estimator=RLLS, Calibration Method=TS2026.04 | — | 6,910 | |
| RLLSShift Estimator=RLLS, Calibration Method=BCTS2026.04 | — | 6,080 | |
| RLLSShift Estimator=RLLS, Calibration Method=NBVS2026.04 | — | 6,590 | |
| RLLSShift Estimator=RLLS, Calibration Method=VS2026.04 | — | 5,820 | |
| RLLS-HardShift Estimator=RLLS-Hard, Calibration Method=None2026.04 | — | 7,430 |