List your company
ResearchFormerly WizWand

Learning to Defer on CIFAR-10 (test)

71.31Deferral Ratio (Expert 1)TDEF
36.178845.299454.4263.5406Apr 30, 2026
Updated 6mo ago

Evaluation results

MethodLinks
TDEFSetup=I, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0471.310.052—19.189.51——
MILDSetup=I, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0470.010.0403—19.9910——
MILDSetup=I, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0467.02—0.577920.0412.94——
TDEFSetup=I, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0463.68—0.59523.6112.71——
TDEFSetup=II, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0451.540.0924—19.5318.7610.17—
MILDSetup=II, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0451.50.0847—19.4118.9910.1—
TDEFSetup=II, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0448.11—0.442122.8118.3110.77—
MILDSetup=II, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0444.87—0.42422.6520.511.98—
MILDSetup=III, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0440.40.0903—20.1319.9410.738.8
TDEFSetup=III, Cost type=error, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0438.940.1062—20.9320.99.879.36
MILDSetup=III, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0437.55—0.351220.2620.4810.0911.62
TDEFSetup=III, Cost type=error + cost, Backbone=ResNet-16, Batch size=1024, Learning rate=1e-3, Optimizer=Adam, Epochs=2002026.0437.53—0.368422.3318.1411.7510.25