Learning to Defer on Tiny ImageNet (test)
71.8Deferral Ratio (%) - Expert 1TDEF
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| TDEFSetup=I, Cost type=error2026.04 | 71.8 | 34.88 | — | 28.16 | 0.04 | — | — | |
| MILDSetup=I, Cost type=error2026.04 | 70.68 | 33.65 | — | 19.25 | 10.07 | — | — | |
| MILDSetup=II, Cost type=error2026.04 | 54.69 | 50.72 | — | 12.23 | 14.82 | 18.26 | — | |
| TDEFSetup=II, Cost type=error2026.04 | 47.81 | 52.87 | — | 35.1 | 14.78 | 2.31 | — | |
| MILDSetup=III, Cost type=error2026.04 | 46.09 | 56.56 | — | 18.91 | 31.29 | 3.24 | 0.47 | |
| TDEFSetup=III, Cost type=error2026.04 | 36.38 | 58.57 | — | 17.02 | 36.02 | 9.95 | 0.63 | |
| TDEFSetup=III, Cost type=error + cost2026.04 | 33.65 | — | 84.81 | 42.02 | 8.92 | 8.82 | 6.59 | |
| TDEFSetup=II, Cost type=error + cost2026.04 | 32.27 | — | 85.76 | 16.68 | 18.72 | 32.33 | — | |
| MILDSetup=II, Cost type=error + cost2026.04 | 28.91 | — | 83.24 | 7.27 | 24.55 | 39.27 | — | |
| MILDSetup=III, Cost type=error + cost2026.04 | 17.22 | — | 81.67 | 10.02 | 15.48 | 35.43 | 21.85 | |
| MILDSetup=I, Cost type=error + cost2026.04 | 8.49 | — | 86.53 | 43.39 | 48.12 | — | — | |
| TDEFSetup=I, Cost type=error + cost2026.04 | 4.57 | — | 88.19 | 75.31 | 20.12 | — | — |