OOD Detection on CIFAR-10 (test) using Specialized AUROC Metrics
0.995Clean AUROCViT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ViTscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.995 | 0.26 | 0.571 | 0.004 | |
| ViTscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.984 | 0.339 | 0.355 | 0.007 | |
| ViTscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.975 | 0.578 | 0.28 | 0.013 | |
| OpenGAN-feaepsilon=4/255, attack_type=PGD2022.09 | 0.971 | 0.521 | 0.444 | 0.318 | |
| ViTscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.951 | 0.526 | 0.493 | 0.043 | |
| ATDepsilon=4/255, attack_type=PGD2022.09 | 0.943 | 0.915 | 0.919 | 0.883 | |
| HATscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.878 | 0.74 | 0.764 | 0.573 | |
| ALOEscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.869 | 0.658 | 0.679 | 0.422 | |
| ALOEscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.843 | 0.667 | 0.612 | 0.373 | |
| ATscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.836 | 0.64 | 0.69 | 0.453 | |
| OSADscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.827 | 0.696 | 0.699 | 0.535 | |
| ALOEscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.827 | 0.602 | 0.646 | 0.406 | |
| HATscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.821 | 0.729 | 0.741 | 0.633 | |
| OpenGAN-pixelepsilon=4/255, attack_type=PGD2022.09 | 0.818 | 0.001 | 0.052 | 0 | |
| ALOEscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.815 | 0.512 | 0.57 | 0.213 | |
| ATscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.805 | 0.647 | 0.669 | 0.489 | |
| AOEscoring_function=OpenMax, epsilon=4/255, attack_type=PGD2022.09 | 0.797 | 0.675 | 0.702 | 0.559 | |
| HATscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.789 | 0.691 | 0.688 | 0.579 | |
| AOEscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.78 | 0.658 | 0.654 | 0.514 | |
| AOEscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.78 | 0.562 | 0.595 | 0.337 | |
| OSADscoring_function=RMD, epsilon=4/255, attack_type=PGD2022.09 | 0.776 | 0.576 | 0.619 | 0.384 | |
| ATscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.771 | 0.603 | 0.65 | 0.473 | |
| HATscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.77 | 0.665 | 0.658 | 0.541 | |
| ATscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.735 | 0.573 | 0.564 | 0.394 | |
| AOEscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.709 | 0.515 | 0.587 | 0.407 | |
| OSADscoring_function=MSP, epsilon=4/255, attack_type=PGD2022.09 | 0.698 | 0.521 | 0.516 | 0.347 | |
| OSADscoring_function=MD, epsilon=4/255, attack_type=PGD2022.09 | 0.626 | 0.5 | 0.521 | 0.402 |