Failure Detection on CIFAR100 (test)
369.86AURCGradnorm
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GradnormArchitecture=ResNet110, Duplicate=true2024.11 | 369.86 | 98.82 | 35.3 | 72.01 | |
| GradnormArchitecture=DenseNet, Duplicate=true2024.11 | 249.85 | 94.73 | 49.88 | 74.62 | |
| GradnormArchitecture=DenseNet2024.11 | 159.95 | 95.3 | 64.54 | 74.62 | |
| EnergyArchitecture=ResNet1102024.11 | 135.85 | 74.66 | 77.2 | 72.01 | |
| GradnormArchitecture=WRNet, Duplicate=true2024.11 | 134.85 | 76.2 | 68.51 | 78.55 | |
| MaxLogitArchitecture=ResNet1102024.11 | 133.19 | 72.33 | 77.96 | 72.01 | |
| LogitNormArchitecture=ResNet1102024.11 | 125.59 | 72.87 | 79.71 | 70.34 | |
| GradnormArchitecture=ResNet1102024.11 | 114.21 | 73.48 | 80.41 | 72.01 | |
| LogitNormArchitecture=DenseNet2024.11 | 109.8 | 73.28 | 78.9 | 73.8 | |
| EnergyArchitecture=DenseNet2024.11 | 108.8 | 72.79 | 78.73 | 74.62 | |
| MaxLogitArchitecture=DenseNet2024.11 | 105.98 | 70.2 | 79.6 | 74.62 | |
| SIRCArchitecture=ResNet1102024.11 | 100.56 | 66.37 | 84.01 | 72.01 | |
| EntropyArchitecture=ResNet1102024.11 | 100.05 | 66.28 | 84.12 | 72.01 | |
| MSPArchitecture=ResNet1102024.11 | 99.83 | 67.49 | 84.07 | 72.01 | |
| CosineArchitecture=ResNet1102024.11 | 96.53 | 65.15 | 84.42 | 72.01 | |
| TALArchitecture=ResNet1102024.11 | 90.6 | 64.84 | 85.36 | 72.45 | |
| OpenMixArchitecture=ResNet1102024.11 | 85.66 | 63.82 | 85.25 | 73.68 | |
| CosineArchitecture=DenseNet2024.11 | 82.36 | 63.65 | 84.72 | 74.62 | |
| SIRCArchitecture=DenseNet2024.11 | 80.21 | 65.41 | 85.37 | 74.62 | |
| EntropyArchitecture=DenseNet2024.11 | 79.94 | 65.41 | 85.46 | 74.62 | |
| MSPArchitecture=DenseNet2024.11 | 79.06 | 63.62 | 85.75 | 74.62 | |
| LogitNormArchitecture=WRNet2024.11 | 78.86 | 65.56 | 82.68 | 77.15 | |
| GradnormArchitecture=WRNet2024.11 | 76.43 | 72.99 | 81.44 | 78.55 | |
| TALArchitecture=DenseNet2024.11 | 73.28 | 60.9 | 86.51 | 75.14 | |
| TAL w/ FMFPArchitecture=ResNet1102024.11 | 73.16 | 64.82 | 85.51 | 75.59 | |
| FMFPArchitecture=ResNet1102024.11 | 69.83 | 62.17 | 87.15 | 75.18 | |
| EnergyArchitecture=WRNet2024.11 | 66.33 | 65.64 | 84.73 | 78.55 | |
| MaxLogitArchitecture=WRNet2024.11 | 64.85 | 62.7 | 85.36 | 78.55 | |
| OpenMixArchitecture=DenseNet2024.11 | 64.11 | 59.52 | 87.29 | 77.03 | |
| TAL w/ FMFPArchitecture=DenseNet2024.11 | 60.52 | 63.65 | 86.57 | 77.85 | |
| SIRCArchitecture=WRNet2024.11 | 59.57 | 63.38 | 86.7 | 78.55 | |
| EntropyArchitecture=WRNet2024.11 | 59.31 | 62.78 | 86.8 | 78.55 | |
| MSPArchitecture=WRNet2024.11 | 57.6 | 60.13 | 87.47 | 78.55 | |
| CosineArchitecture=WRNet2024.11 | 56.68 | 58.65 | 87.56 | 78.55 | |
| FMFPArchitecture=DenseNet2024.11 | 56.67 | 62.45 | 87.72 | 77.96 | |
| TALArchitecture=WRNet2024.11 | 55.41 | 58.43 | 88.41 | 78.14 | |
| OpenMixArchitecture=WRNet2024.11 | 50.05 | 56.36 | 88.73 | 79.52 | |
| TAL w/ FMFPArchitecture=WRNet2024.11 | 44.21 | 58.77 | 88.4 | 80.98 | |
| FMFPArchitecture=WRNet2024.11 | 41.6 | 56.65 | 89.5 | 81.07 |