Learning to Defer on SVHN (test)
83.27Deferral Ratio (Expert 1)TDEF
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TDEFSetup=I, Cost type=error2026.04 | 83.27 | 4.68 | — | 12.01 | 4.72 | — | — | |
| MILDSetup=I, Cost type=error2026.04 | 80.33 | 2.54 | — | 13.39 | 6.28 | — | — | |
| MILDSetup=I, Cost type=error + cost2026.04 | 78.33 | — | 61.7 | 14.58 | 7.09 | — | — | |
| TDEFSetup=I, Cost type=error + cost2026.04 | 77.75 | — | 62.85 | 14.71 | 7.54 | — | — | |
| MILDSetup=II, Cost type=error2026.04 | 63.99 | 3.42 | — | 14.56 | 14.07 | 7.38 | — | |
| TDEFSetup=II, Cost type=error2026.04 | 63.47 | 6.04 | — | 14.87 | 14.76 | 6.91 | — | |
| MILDSetup=II, Cost type=error + cost2026.04 | 61.04 | — | 41.48 | 17.86 | 14.04 | 7.06 | — | |
| TDEFSetup=II, Cost type=error + cost2026.04 | 60.79 | — | 42.65 | 15.5 | 15.85 | 7.86 | — | |
| MILDSetup=III, Cost type=error2026.04 | 54.12 | 3.53 | — | 18.46 | 14.75 | 6.17 | 6.5 | |
| TDEFSetup=III, Cost type=error2026.04 | 53.47 | 6.84 | — | 17.47 | 15.75 | 7.72 | 5.59 | |
| MILDSetup=III, Cost type=error + cost2026.04 | 52.22 | — | 32.9 | 19.02 | 15.82 | 6.63 | 6.31 | |
| TDEFSetup=III, Cost type=error + cost2026.04 | 52.13 | — | 34.12 | 18.02 | 15.93 | 6.39 | 7.53 |