Anomaly Detection on MNIST one-class classification
0.994AUROCUTAD
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| UTADL_info=True, EN=True, Guide=True, m_hat=True2021.03 | 0.994 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uninformed StudentsLk (loss weight)=1, Lm (loss weight)=1, Lc (loss weight)=02019.11 | 0.9935 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uninformed StudentsLk (loss weight)=0, Lm (loss weight)=1, Lc (loss weight)=12019.11 | 0.9935 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnSt2021.03 | 0.993 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UTADL_info=True, EN=True, Guide=True2021.03 | 0.993 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uninformed StudentsLk (loss weight)=1, Lm (loss weight)=1, Lc (loss weight)=12019.11 | 0.9926 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UTADL_info=True, EN=True, m_hat=True2021.03 | 0.992 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Uninformed StudentsLk (loss weight)=0, Lm (loss weight)=1, Lc (loss weight)=02019.11 | 0.9917 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UTADEN=True2021.03 | 0.989 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UTADL_info=True, EN=True2021.03 | 0.988 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CAVGA2021.03 | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | |
| l2-AE2019.11 | 0.9832 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARNetProtocol=One-class training protocol2019.11 | 0.983 | 0.986 | 0.999 | 0.99 | 0.991 | 0.981 | 0.981 | 0.997 | 0.99 | 0.936 | 0.978 | 1.78 | — | |
| AE_L22021.03 | 0.983 | — | — | — | — | — | — | — | — | — | — | — | — | |
| UTADL_info=True2021.03 | 0.981 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GeoTransProtocol=One-class training protocol2019.11 | 0.98 | 0.982 | 0.916 | 0.994 | 0.99 | 0.991 | 0.996 | 0.999 | 0.963 | 0.972 | 0.992 | 2.5 | — | |
| UTADAblation=Baseline2021.03 | 0.979 | — | — | — | — | — | — | — | — | — | — | — | — | |
| P-KDGAN2020.07 | 0.978 | 0.996 | 0.999 | 0.969 | 0.969 | 0.97 | 0.951 | 0.992 | 0.982 | 0.965 | 0.987 | — | — | |
| OCGANProtocol=Protocol 12019.03 | 0.977 | — | — | — | — | — | — | — | — | — | — | — | — | |
| 1-NN2019.11 | 0.9753 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OCGAN2019.11 | 0.975 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OCGANProtocol=One-class training protocol2019.11 | 0.975 | 0.998 | 0.999 | 0.942 | 0.963 | 0.975 | 0.98 | 0.991 | 0.981 | 0.939 | 0.981 | 2.1 | — | |
| OCGAN2021.03 | 0.975 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LSA2021.03 | 0.975 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OCGAN2020.07 | 0.975 | 0.998 | 0.999 | 0.942 | 0.963 | 0.975 | 0.98 | 0.991 | 0.981 | 0.939 | 0.981 | — | — | |
| VAE2020.07 | 0.9696 | 0.997 | 0.999 | 0.936 | 0.959 | 0.973 | 0.964 | 0.993 | 0.976 | 0.923 | 0.976 | — | — | |
| AND2020.07 | 0.9671 | 0.984 | 0.995 | 0.947 | 0.952 | 0.96 | 0.971 | 0.991 | 0.97 | 0.922 | 0.979 | — | — | |
| VAE2019.11 | 0.9535 | — | — | — | — | — | — | — | — | — | — | — | — | |
| OCSVM2020.07 | 0.9513 | 0.988 | 0.999 | 0.902 | 0.95 | 0.955 | 0.968 | 0.978 | 0.965 | 0.853 | 0.955 | — | — | |
| DSVDD2020.07 | 0.948 | 0.98 | 0.997 | 0.917 | 0.919 | 0.949 | 0.885 | 0.983 | 0.946 | 0.939 | 0.965 | — | — | |
| ADGANProtocol=One-class training protocol2019.11 | 0.947 | 0.995 | 0.999 | 0.936 | 0.921 | 0.949 | 0.936 | 0.967 | 0.968 | 0.854 | 0.957 | 4.15 | — | |
| OC-SVM2019.11 | 0.9463 | — | — | — | — | — | — | — | — | — | — | — | — | |
| KMeans2019.11 | 0.9457 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SkipGAN2021.03 | 0.941 | — | — | — | — | — | — | — | — | — | — | — | — | |
| AnoGANProtocol=One-class training protocol2019.11 | 0.937 | 0.99 | 0.998 | 0.888 | 0.913 | 0.944 | 0.912 | 0.925 | 0.964 | 0.883 | 0.958 | 4 | — | |
| AnoGAN2021.03 | 0.937 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ALOCCProtocol=One-class training protocol2019.11 | 0.933 | 0.995 | 0.991 | 0.92 | 0.921 | 0.935 | 0.847 | 0.975 | 0.941 | 0.875 | 0.928 | 4.7 | — | |
| GPNDProtocol=Protocol 12019.03 | 0.932 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GANomalyProtocol=One-class training protocol2019.11 | 0.928 | 0.972 | 0.996 | 0.851 | 0.906 | 0.945 | 0.949 | 0.971 | 0.939 | 0.797 | 0.954 | 6.12 | — | |
| AEProtocol=One-class training protocol2019.11 | 0.919 | 0.988 | 0.993 | 0.917 | 0.885 | 0.862 | 0.858 | 0.954 | 0.94 | 0.823 | 0.965 | 5.9 | — | |
| AnoGAN2020.07 | 0.9127 | 0.966 | 0.992 | 0.85 | 0.887 | 0.894 | 0.883 | 0.947 | 0.935 | 0.849 | 0.924 | — | — | |
| DCAEProtocol=Protocol 12019.03 | 0.899 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ALOCC DRProtocol=Protocol 12019.03 | 0.88 | — | — | — | — | — | — | — | — | — | — | — | — | |
| VAEProtocol=One-class training protocol2019.11 | 0.877 | 0.921 | 0.999 | 0.815 | 0.814 | 0.879 | 0.811 | 0.943 | 0.886 | 0.78 | 0.92 | 7.05 | — | |
| CapsNet2021.03 | 0.871 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ALOCC DProtocol=Protocol 12019.03 | 0.82 | — | — | — | — | — | — | — | — | — | — | — | — | |
| KDE2020.07 | 0.8143 | 0.885 | 0.996 | 0.71 | 0.693 | 0.844 | 0.776 | 0.861 | 0.884 | 0.669 | 0.825 | — | — | |
| ADGANhighest AUC among all training epochs=true2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 94.7 | |
| ALOCChighest AUC among all training epochs=true2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 93.3 | |
| AnoGAN2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 93.7 | |
| BCESupervision Protocol=Supervised OE2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.4 | |
| DAAD2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 99 | |
| DGEOhighest test AUC among multiple runs=true2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 98 | |
| DSADSupervision Protocol=Unsupervised OE2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | 97.6 | |
| DSVDDSupervision Protocol=Unsupervised2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | 97.6 | |
| FocalSupervision Protocol=Supervised OE2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.4 | |
| GANomalyhighest AUC among all training epochs=true2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 92.8 | |
| HRN2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 97.6 | |
| HSCSupervision Protocol=Unsupervised OE2022.05 | — | — | — | — | — | — | — | — | — | — | — | — | 98.2 | |
| LSA2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 97.5 | |
| MKD2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 98.7 | |
| OCGAN2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 97.5 | |
| OCGAN2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 97.3 | |
| P-KDGAN2020.12 | — | — | — | — | — | — | — | — | — | — | — | — | 97.8 | |
| Reverse Distillation2022.01 | — | — | — | — | — | — | — | — | — | — | — | — | 99.3 |