Learning to Defer on CIFAR-100 varying-accuracy synthetic expert (test)
18.09Error RatePiCCE-CE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PiCCE-CELoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=20, Backbone=ResNet-182026.02 | 18.09 | 78.45 | |
| PiCCE-CELoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=16, Backbone=ResNet-182026.02 | 18.13 | 78.65 | |
| PiCCE-CELoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=12, Backbone=ResNet-182026.02 | 18.21 | 78.09 | |
| PiCCE-CELoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=8, Backbone=ResNet-182026.02 | 18.38 | 77.76 | |
| PiCCE-CELoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=4, Backbone=ResNet-182026.02 | 18.4 | 77.16 | |
| PiCCE-OvALoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=20, Backbone=ResNet-182026.02 | 18.69 | 85.78 | |
| PiCCE-OvALoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=16, Backbone=ResNet-182026.02 | 18.83 | 85.85 | |
| PiCCE-OvALoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=12, Backbone=ResNet-182026.02 | 18.88 | 85.99 | |
| PiCCE-OvALoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=8, Backbone=ResNet-182026.02 | 18.95 | 85.1 | |
| CELoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=4, Backbone=ResNet-182026.02 | 18.96 | 75.34 | |
| PiCCE-OvALoss Formulation=PiCCE, Expert Pattern=Varying-Acc Animal Expert, #Exp=4, Backbone=ResNet-182026.02 | 19.01 | 86.33 | |
| OvALoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=4, Backbone=ResNet-182026.02 | 19.07 | 85.04 | |
| CELoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=8, Backbone=ResNet-182026.02 | 19.56 | 76.59 | |
| CELoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=12, Backbone=ResNet-182026.02 | 20.18 | 75.31 | |
| OvALoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=8, Backbone=ResNet-182026.02 | 20.65 | 84.27 | |
| CELoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=16, Backbone=ResNet-182026.02 | 22.46 | 76.1 | |
| CELoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=20, Backbone=ResNet-182026.02 | 22.56 | 76.13 | |
| OvALoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=12, Backbone=ResNet-182026.02 | 22.65 | 83.8 | |
| OvALoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=16, Backbone=ResNet-182026.02 | 24.77 | 79.21 | |
| OvALoss Formulation=Vanilla, Expert Pattern=Varying-Acc Animal Expert, #Exp=20, Backbone=ResNet-182026.02 | 26.08 | 78.02 |