Selective Classification on CIFAR-10 (test)
100AccuracySR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SRDeclaration Rate=10%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=10%2026.04 | 100 | — | — | — | — | |
| SRDeclaration Rate=20%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=20%2026.04 | 100 | — | — | — | — | |
| SRDeclaration Rate=30%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=30%2026.04 | 100 | — | — | — | — | |
| SRDeclaration Rate=40%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=40%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=50%2026.04 | 100 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=60%2026.04 | 100 | — | — | — | — | |
| MetaErrDeclaration Rate=50%2026.04 | 99.99 | — | — | — | — | |
| MetaErrDeclaration Rate=60%2026.04 | 99.99 | — | — | — | — | |
| MetaErrDeclaration Rate=30%2026.04 | 99.98 | — | — | — | — | |
| MetaErrDeclaration Rate=40%2026.04 | 99.98 | — | — | — | — | |
| MetaErrDeclaration Rate=20%2026.04 | 99.97 | — | — | — | — | |
| MetaErrDeclaration Rate=10%2026.04 | 99.93 | — | — | — | — | |
| SRDeclaration Rate=50%2026.04 | 99.8 | — | — | — | — | |
| SRDeclaration Rate=60%2026.04 | 99.3 | — | — | — | — | |
| BALDDeclaration Rate=10%2026.04 | 96.77 | — | — | — | — | |
| BALDDeclaration Rate=20%2026.04 | 94.05 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=70%2026.04 | 92.54 | — | — | — | — | |
| MetaErrDeclaration Rate=70%2026.04 | 91.51 | — | — | — | — | |
| SRDeclaration Rate=70%2026.04 | 90.87 | — | — | — | — | |
| BALDDeclaration Rate=30%2026.04 | 90.7 | — | — | — | — | |
| EDLUncertainty measure=Entropy (Ent)2024.02 | 89.9 | — | 0.897 | — | 49.2 | |
| EDLUncertainty measure=Max Probability (MaxP)2024.02 | 89.9 | — | 0.897 | — | 48.8 | |
| END2Uncertainty measure=Entropy (Ent)2024.02 | 89.4 | — | 0.898 | — | 50.6 | |
| END2Uncertainty measure=Max Probability (MaxP)2024.02 | 89.4 | — | 0.896 | — | 51.1 | |
| Bootstrap DistillUncertainty measure=Entropy (Ent)2024.02 | 89.4 | — | 0.903 | — | 51.2 | |
| Bootstrap DistillUncertainty measure=Max Probability (MaxP)2024.02 | 89.4 | — | 0.902 | — | 52.1 | |
| S2DUncertainty measure=Entropy (Ent)2024.02 | 89.1 | — | 0.894 | — | 50.5 | |
| S2DUncertainty measure=Max Probability (MaxP)2024.02 | 89.1 | — | 0.893 | — | 51 | |
| BMUncertainty measure=Entropy (Ent)2024.02 | 88.7 | — | 0.901 | — | 51.5 | |
| BMUncertainty measure=Max Probability (MaxP)2024.02 | 88.7 | — | 0.9 | — | 51.6 | |
| PostNetUncertainty measure=Entropy (Ent)2024.02 | 88.4 | — | 0.892 | — | 50.4 | |
| PostNetUncertainty measure=Max Probability (MaxP)2024.02 | 88.4 | — | 0.892 | — | 50.7 | |
| Fisher-EDLUncertainty measure=Entropy (Ent)2024.02 | 88.2 | — | 0.904 | — | 53.7 | |
| Fisher-EDLUncertainty measure=Max Probability (MaxP)2024.02 | 88.2 | — | 0.904 | — | 53.8 | |
| BALDDeclaration Rate=40%2026.04 | 87.13 | — | — | — | — | |
| DDUDeclaration Rate=10%2026.04 | 85.87 | — | — | — | — | |
| RPriorNetUncertainty measure=Entropy (Ent)2024.02 | 85.4 | — | 0.86 | — | 49.7 | |
| RPriorNetUncertainty measure=Max Probability (MaxP)2024.02 | 85.4 | — | 0.866 | — | 51.3 | |
| EnergyDeclaration Rate=10%2026.04 | 85.2 | — | — | — | — | |
| NatPNUncertainty measure=Entropy (Ent)2024.02 | 83.2 | — | 0.862 | — | 53.5 | |
| NatPNUncertainty measure=Max Probability (MaxP)2024.02 | 83.2 | — | 0.864 | — | 54.4 | |
| BALDDeclaration Rate=50%2026.04 | 82.88 | — | — | — | — | |
| DDUDeclaration Rate=20%2026.04 | 82.35 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=80%2026.04 | 81.1 | — | — | — | — | |
| MetaErrDeclaration Rate=80%2026.04 | 80.07 | — | — | — | — | |
| BALDDeclaration Rate=60%2026.04 | 78.91 | — | — | — | — | |
| SRDeclaration Rate=80%2026.04 | 78.76 | — | — | — | — | |
| EnergyDeclaration Rate=20%2026.04 | 76.63 | — | — | — | — | |
| DDUDeclaration Rate=30%2026.04 | 76.56 | — | — | — | — | |
| EnergyDeclaration Rate=30%2026.04 | 75.81 | — | — | — | — | |
| BALDDeclaration Rate=70%2026.04 | 75.34 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=90%2026.04 | 72.19 | — | — | — | — | |
| BALDDeclaration Rate=80%2026.04 | 71.52 | — | — | — | — | |
| MetaErrDeclaration Rate=90%2026.04 | 71.17 | — | — | — | — | |
| SRDeclaration Rate=90%2026.04 | 70.19 | — | — | — | — | |
| DDUDeclaration Rate=40%2026.04 | 68.47 | — | — | — | — | |
| BALDDeclaration Rate=90%2026.04 | 67.96 | — | — | — | — | |
| DDUDeclaration Rate=50%2026.04 | 66.18 | — | — | — | — | |
| DDUDeclaration Rate=60%2026.04 | 66.06 | — | — | — | — | |
| EnergyDeclaration Rate=40%2026.04 | 65.79 | — | — | — | — | |
| EnergyDeclaration Rate=50%2026.04 | 65.79 | — | — | — | — | |
| EnergyDeclaration Rate=60%2026.04 | 65.51 | — | — | — | — | |
| DDUDeclaration Rate=70%2026.04 | 65.32 | — | — | — | — | |
| EnergyDeclaration Rate=70%2026.04 | 65.26 | — | — | — | — | |
| EnergyDeclaration Rate=80%2026.04 | 64.91 | — | — | — | — | |
| RandomDeclaration Rate=10%2026.04 | 64.8 | — | — | — | — | |
| EnergyDeclaration Rate=90%2026.04 | 64.55 | — | — | — | — | |
| DDUDeclaration Rate=80%2026.04 | 64.47 | — | — | — | — | |
| RandomDeclaration Rate=20%2026.04 | 64.45 | — | — | — | — | |
| DDUDeclaration Rate=90%2026.04 | 64.38 | — | — | — | — | |
| RandomDeclaration Rate=40%2026.04 | 64.37 | — | — | — | — | |
| RandomDeclaration Rate=30%2026.04 | 64.34 | — | — | — | — | |
| RandomDeclaration Rate=50%2026.04 | 64.33 | — | — | — | — | |
| MC DropoutDeclaration Rate=50%2026.04 | 64.33 | — | — | — | — | |
| RandomDeclaration Rate=70%2026.04 | 64.28 | — | — | — | — | |
| MC DropoutDeclaration Rate=70%2026.04 | 64.26 | — | — | — | — | |
| RandomDeclaration Rate=90%2026.04 | 64.24 | — | — | — | — | |
| MC DropoutDeclaration Rate=80%2026.04 | 64.23 | — | — | — | — | |
| MC DropoutDeclaration Rate=60%2026.04 | 64.22 | — | — | — | — | |
| RandomDeclaration Rate=60%2026.04 | 64.17 | — | — | — | — | |
| MC DropoutDeclaration Rate=90%2026.04 | 64.13 | — | — | — | — | |
| RandomDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| BALDDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| MC DropoutDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| SRDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| EnergyDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| DDUDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| MetaErrDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| MetaErr + SRDeclaration Rate=100%2026.04 | 64.08 | — | — | — | — | |
| MC DropoutDeclaration Rate=40%2026.04 | 64.07 | — | — | — | — | |
| RandomDeclaration Rate=80%2026.04 | 64.06 | — | — | — | — | |
| MC DropoutDeclaration Rate=30%2026.04 | 64.02 | — | — | — | — | |
| MC DropoutDeclaration Rate=20%2026.04 | 63.68 | — | — | — | — | |
| MC DropoutDeclaration Rate=10%2026.04 | 62.73 | — | — | — | — | |
| EBDattack=PGD-1000, restarts=10, step size=2/255, perturbation constraint=8/255, threat model=l_inf2021.05 | — | 56.12 | 0.763 | — | — | |
| RRattack=PGD-1000, restarts=10, step size=2/255, perturbation constraint=8/255, threat model=l_inf2021.05 | — | 57.57 | 0.773 | — | — |