Failure Detection on ImageNet vs. WILDS New setting
409.89AURCResidual
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ResidualArchitecture=ResNet502024.11 | 409.89 | 84.39 | 77.99 | |
| GradnormArchitecture=ResNet50, variant=12024.11 | 382.46 | 80.91 | 81.51 | |
| GradnormArchitecture=ResNet50, variant=22024.11 | 363.03 | 38.02 | 87.56 | |
| CosineArchitecture=ResNet502024.11 | 326.97 | 68.92 | 87.81 | |
| MSPArchitecture=ResNet502024.11 | 326.85 | 60.19 | 87.42 | |
| SIRCArchitecture=ResNet502024.11 | 322.41 | 54.43 | 88.46 | |
| EnergyArchitecture=ResNet502024.11 | 318.89 | 45.27 | 90.6 | |
| MaxLogitArchitecture=ResNet502024.11 | 317.46 | 45.46 | 90.69 | |
| EntropyArchitecture=ResNet502024.11 | 316.26 | 54.32 | 89.47 | |
| TALArchitecture=ResNet502024.11 | 288.67 | 45.55 | 92.91 |