Image Classification on ImageNet (val) (Efficiency Gain)
66.73Efficiency Gain (%)Dyn-Perc
Evaluation results
| Method | Links | |
|---|---|---|
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 66.73 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 65.25 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 65.04 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 64.38 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 63.9 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 63.77 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 62.55 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 62.51 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 62.04 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 61.6 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 60.87 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 60.28 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 59.42 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 58.62 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 58.6 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 58.6 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 58.12 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 58.05 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 57.99 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 56.01 | |
| MSDNetRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 56 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 55.16 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 54.89 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 54.28 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 53.81 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 53.67 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 52.31 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 52.21 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 51.83 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 51.7 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 51.09 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 50.82 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 50.57 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 50.56 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 50.4 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 50.34 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 50.02 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 49.9 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 49.86 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 49.71 | |
| L2W-DENRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 49.47 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 49.32 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 48.68 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 48.48 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 48.31 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 47.97 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 47.73 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 46.89 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 46.56 | |
| DVITRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 46.5 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 46.26 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 46.12 | |
| MSDNetRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 46.11 | |
| Dyn-PercRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 45.42 | |
| DVITRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 45.14 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 44.66 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 44.39 | |
| MSDNetRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 44 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 43.68 | |
| MSDNetRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 43.65 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 43.6 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 43.58 | |
| Dyn-PercRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 43.35 | |
| MSDNetRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 42.51 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 42.24 | |
| L2W-DENRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 41.77 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 41.64 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 40.75 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 40.54 | |
| DVITRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 40.36 | |
| DVITRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 39.74 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 39.05 | |
| DVITRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 38.48 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 38.24 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 38.11 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 37.08 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 36.86 | |
| L2W-DENRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 35.77 | |
| Dyn-PercRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 35.67 | |
| DVITRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 35.4 | |
| L2W-DENRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 35.09 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 35.09 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 34.93 | |
| Dyn-PercRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 34.85 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 34.61 | |
| DVITRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 34.5 | |
| MSDNetRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 34.21 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 34.09 | |
| L2W-DENRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 33.76 | |
| MSDNetRisk Control=UCB, Calibration size n=1000, Risk Formulation=Global, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 33.23 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 33.11 | |
| L2W-DENRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 33.09 | |
| MSDNetRisk Control=CRC, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 33.01 | |
| L2W-DENRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 32.04 | |
| Dyn-PercRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.052024.05 | 31.71 | |
| Dyn-PercRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.012024.05 | 31.19 | |
| MSDNetRisk Control=CRC, Calibration size n=100, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 30.71 | |
| MSDNetRisk Control=UCB, Calibration size n=100, Risk Formulation=Global, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 30.62 | |
| Dyn-PercRisk Control=UCB, Calibration size n=1000, Risk Formulation=Conditional, Risk Type=0-1 loss, Risk Level epsilon=0.012024.05 | 30.48 | |
| MSDNetRisk Control=UCB, Calibration size n=100, Risk Formulation=Conditional, Risk Type=Brier score, Risk Level epsilon=0.052024.05 | 30.47 |