Anomaly Detection on MVTec AD 1.0 (test)
100Image AUROCSIA
Evaluation results
| Method | Links | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SIACategory=Grid2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.51 | 97.28 | |
| SIACategory=Leather2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.76 | 96.22 | |
| SIACategory=Bottle2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.3 | 95.62 | |
| SIACategory=Hazelnut2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.68 | 93.14 | |
| SIACategory=Transistor2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98 | 92.92 | |
| DTDCategory=Carpet2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.27 | 96.96 | |
| DTDCategory=Grid2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.57 | 97.14 | |
| NSACategory=Grid2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.32 | 91.31 | |
| CutPasteCategory=Grid2024.03 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.18 | 92.53 | |
| SIACategory=Tile2024.03 | 99.96 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.44 | 97.7 | |
| DTDCategory=Texture AVG2024.03 | 99.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.25 | 95.4 | |
| SIACategory=Carpet2024.03 | 99.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.19 | 96.41 | |
| SIACategory=Zipper2024.03 | 99.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.17 | 93.43 | |
| SIACategory=Texture AVG2024.03 | 99.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.22 | 95.63 | |
| NSACategory=Carpet2024.03 | 99.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.6 | 88.77 | |
| SIACategory=Metal Nut2024.03 | 99.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.58 | 94.39 | |
| SIACategory=Total AVG2024.03 | 99.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.03 | 93.07 | |
| CutPasteCategory=Texture AVG2024.03 | 99.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 97.99 | 88.87 | |
| SimpleNet2024.03 | 99.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RealNetBackbone=WideResNet502024.03 | 99.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SIACategory=Object AVG2024.03 | 99.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.93 | 91.79 | |
| SIACategory=Capsule2024.03 | 99.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.32 | 84.48 | |
| DTDCategory=Total AVG2024.03 | 99.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.92 | 91.4 | |
| NSACategory=Texture AVG2024.03 | 99.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 97.57 | 90.11 | |
| SIACategory=Toothbrush2024.03 | 99.44 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.71 | 91.57 | |
| FastFlow2024.03 | 99.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RD++2024.03 | 99.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NSACategory=Total AVG2024.03 | 99.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.28 | 90.73 | |
| DTDCategory=Object AVG2024.03 | 99.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.75 | 89.4 | |
| BGADtraining_setting=Multi-class, abnormal_samples=10, supervision=Supervised2022.07 | 99.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NSACategory=Object AVG2024.03 | 99.28 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.63 | 91.04 | |
| CutPasteCategory=Carpet2024.03 | 99.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.42 | 93.85 | |
| SIACategory=Wood2024.03 | 99.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.22 | 90.54 | |
| SIACategory=Cable2024.03 | 99.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.1 | 93.38 | |
| SIACategory=Pill2024.03 | 99.13 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.02 | 91.04 | |
| PatchCore2024.03 | 99.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SIACategory=Screw2024.03 | 98.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 99.45 | 87.9 | |
| CutPasteCategory=Total AVG2024.03 | 98.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.14 | 86.4 | |
| TFA-Net2026.03 | 98.7 | — | 99.8 | 99.7 | 100 | 100 | 99.7 | — | 100 | 96.5 | 94.8 | 100 | 99.1 | 96.8 | 98 | 100 | 99.8 | 96 | — | — | — | — | |
| DeSTSeg2024.03 | 98.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PNPT2024.06 | 98.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 97.3 | — | |
| CutPasteCategory=Object AVG2024.03 | 98.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 98.22 | 85.16 | |
| DSR2024.03 | 98.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DRAEM+SSPCAB2024.03 | 98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DraemMethod Paradigm=Reconstruction-based methods2026.03 | 98 | — | 97 | 99.9 | 100 | 99.6 | 99.1 | — | 99.2 | 91.8 | 98.5 | 100 | 98.7 | 98.9 | 93.9 | 100 | 93.1 | 100 | — | — | — | — | |
| DiffAD2024.03 | 97.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MBPFMMethod Paradigm=Embedding-based methods2026.03 | 97.5 | — | 100 | 98 | 100 | 99.6 | 99.5 | — | 100 | 98.8 | 94.5 | 100 | 100 | 96.5 | 91.8 | 88.6 | 97.8 | 97.4 | — | — | — | — | |
| DIADLearning Paradigm=Implicit normality learning2024.06 | 97.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96 | — | |
| UniAD2024.03 | 96.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FCDDtraining_setting=Multi-class, abnormal_samples=10, supervision=Supervised2022.07 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UniADLearning Paradigm=Implicit normality learning2024.06 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96.8 | — | |
| PatchcoreLearning Paradigm=Explicit normality learning2024.06 | 96.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96.8 | — | |
| DRAtraining_setting=Multi-class, abnormal_samples=10, supervision=Supervised2022.07 | 96.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SimpleNetLearning Paradigm=Implicit normality learning2024.06 | 95.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 84.8 | — | |
| IntraMethod Paradigm=Reconstruction-based methods2026.03 | 95 | — | 98.9 | 100 | 100 | 98.2 | 97.5 | — | 100 | 70.3 | 86.5 | 95.7 | 96.9 | 90.2 | 95.7 | 100 | 95.8 | 99.4 | — | — | — | — | |
| DevNettraining_setting=Multi-class, abnormal_samples=10, supervision=Supervised2022.07 | 94.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DFRMethod Paradigm=Reconstruction-based methods2026.03 | 93.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RD4ADLearning Paradigm=Implicit normality learning2024.06 | 93.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 96 | — | |
| GCPFMethod Paradigm=Embedding-based methods2026.03 | 93.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pacth SVDDMethod Paradigm=Embedding-based methods2026.03 | 92.1 | — | 92.9 | 94.6 | 90.9 | 97.8 | 96.5 | — | 98.6 | 90.3 | 76.7 | 92 | 94 | 86.1 | 81.3 | 100 | 91.5 | 97.9 | — | — | — | — | |
| RIADMethod Paradigm=Reconstruction-based methods2026.03 | 91.7 | — | 84.2 | 99.6 | 100 | 98.7 | 93 | — | 99.9 | 81.9 | 88.4 | 83.3 | 88.5 | 83.8 | 84.5 | 100 | 90.9 | 98.1 | — | — | — | — | |
| TrustMAEMethod Paradigm=Reconstruction-based methods2026.03 | 90.9 | — | 97.4 | 99.1 | 95.1 | 97.3 | 99.8 | — | 97 | 85.1 | 78.8 | 98.5 | 76.1 | 83.3 | 83.4 | 96.9 | 87.5 | 87.5 | — | — | — | — | |
| DraemLearning Paradigm=Implicit normality learning2024.06 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 87.2 | — | |
| SPADEMethod Paradigm=Embedding-based methods2026.03 | 85.5 | — | 92.8 | 47.3 | 95.4 | 96.5 | 95.8 | — | 97.2 | 84.8 | 91 | 88.1 | 71 | 80.1 | 66.7 | 88.9 | 90.3 | 96.6 | — | — | — | — | |
| PadimLearning Paradigm=Explicit normality learning2024.06 | 85.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 88.9 | — | |
| MKDLearning Paradigm=Implicit normality learning2024.06 | 81.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 84.9 | — | |
| P-SVDDLearning Paradigm=Explicit normality learning2024.06 | 72.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.7 | — | |
| AEDistance metric=SSIM2020.12 | — | — | 87 | 94 | 78 | 59 | 73 | — | 93 | 82 | 94 | 97 | 89 | 91 | 96 | 82 | 90 | 88 | — | 86 | — | — | |
| AEDistance metric=L22020.12 | — | — | 59 | 90 | 75 | 51 | 73 | — | 86 | 86 | 88 | 95 | 86 | 85 | 96 | 93 | 86 | 77 | — | 82 | — | — | |
| AE-l22022.10 | — | 82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AE-SSIM2022.10 | — | 86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AnoGAN2020.12 | — | — | 54 | 58 | 64 | 50 | 62 | — | 86 | 78 | 84 | 87 | 76 | 87 | 80 | 90 | 80 | 78 | — | 74 | — | — | |
| CFA2022.06 | — | — | — | — | — | — | — | 99.6 | — | — | — | — | — | — | — | — | — | — | 99.2 | 99.3 | — | — | |
| CFASupervision=Unsupervised, Backbone=WideResNet50, Resolution=256x2562022.12 | — | — | 99.3 | 98.6 | 100 | 99.2 | 100 | — | 100 | 99.9 | 97.4 | 100 | 100 | 97.7 | 95.1 | 100 | 100 | 99.5 | — | 99.1 | — | — | |
| CFA++2022.06 | — | — | — | — | — | — | — | 99.8 | — | — | — | — | — | — | — | — | — | — | 99.4 | 99.5 | — | — | |
| CFLOW2022.06 | — | — | — | — | — | — | — | 98.7 | — | — | — | — | — | — | — | — | — | — | 98 | 98.3 | — | — | |
| CFLOWSupervision=Unsupervised, Backbone=WideResNet50, Resolution=256x2562022.12 | — | — | 97.6 | 98.1 | 99.9 | 97.1 | 98.7 | — | 99.9 | 97.6 | 97 | 100 | 98.5 | 96.2 | 93.1 | 98.8 | 92.9 | 97.1 | — | 97.5 | — | — | |
| CNN-FD2020.12 | — | — | 72 | 59 | 87 | 93 | 91 | — | 78 | 79 | 84 | 72 | 82 | 68 | 87 | 77 | 66 | 76 | — | 78 | — | — | |
| CutPasteImage Size=2562022.01 | — | — | 93.9 | 100 | 100 | 94.6 | 99.1 | 97.5 | 98.2 | 81.2 | 98.2 | 98.3 | 99.9 | 94.9 | 88.7 | 99.4 | 96.1 | 99.9 | 95.5 | 96.1 | — | — | |
| CutPaste2022.06 | — | — | — | — | — | — | — | 98.4 | — | — | — | — | — | — | — | — | — | — | 94.1 | 95.5 | — | — | |
| CutPasteEvaluation Case=Unified2022.06 | — | — | 93.6 | 93.2 | 93.4 | 88.6 | 80.4 | — | 67.9 | 69.2 | 63 | 80.9 | 60 | 71.4 | 85.2 | 63.9 | 57.9 | 93.5 | — | 77.5 | — | — | |
| CutPasteEvaluation Case=Separate2022.06 | — | — | 93.9 | 100 | 100 | 94.6 | 99.1 | — | 98.2 | 81.2 | 98.2 | 98.3 | 99.9 | 94.9 | 88.7 | 99.4 | 96.1 | 99.9 | — | 96.1 | — | — | |
| CutPaste2022.10 | — | 97.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DAADImage Size=2562022.01 | — | — | 86.6 | 95.7 | 86.2 | 88.2 | 98.2 | 91 | 97.6 | 84.4 | 76.7 | 92.1 | 75.8 | 90 | 98.7 | 99.2 | 87.6 | 85.9 | 88.8 | 89.5 | — | — | |
| DevNetSupervision=Supervised, Resolution=256x2562022.12 | — | — | 82.5 | 90.6 | 92.2 | 99.9 | 97.9 | — | 99.7 | 98.7 | 71.9 | 99.7 | 98.8 | 87.1 | 97.2 | 79.2 | 89.1 | 99.1 | — | 92.2 | — | — | |
| DFRRegional feature scales=f{1:12}2020.12 | — | — | 96 | 98 | 99 | 86 | 94 | — | 95 | 88 | 98 | 98 | 90 | 96 | 99 | 98 | 75 | 96 | — | 94 | — | — | |
| DFRRegional feature scales=f{1:16}2020.12 | — | — | 97 | 98 | 98 | 87 | 93 | — | 97 | 92 | 99 | 99 | 93 | 97 | 99 | 99 | 80 | 96 | — | 95 | — | — | |
| DFR2022.10 | — | 95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Diff2022.10 | — | 94.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DRASupervision=Supervised, Resolution=256x2562022.12 | — | — | 92.5 | 98.6 | 98.9 | 100 | 99.1 | — | 100 | 94.2 | 95.1 | 100 | 99.1 | 88.3 | 99.5 | 87.5 | 88.3 | 99.7 | — | 96.1 | — | — | |
| DRAEM2022.10 | — | — | 97 | 99.9 | 100 | 99.6 | 99.1 | — | 99.2 | 91.8 | 98.5 | 100 | 98.7 | 98.9 | 93.9 | 100 | 93.1 | 100 | — | 98 | — | — | |
| DRAEMEvaluation Case=Unified2022.06 | — | — | 98 | 99.3 | 98.7 | 99.8 | 99.8 | — | 97.5 | 57.8 | 65.3 | 93.7 | 72.8 | 82.2 | 92 | 90.6 | 74.8 | 98.8 | — | 88.1 | — | — | |
| DRAEMEvaluation Case=Separate2022.06 | — | — | 97 | 99.9 | 100 | 99.6 | 99.1 | — | 99.2 | 91.8 | 98.5 | 100 | 98.7 | 98.9 | 93.9 | 100 | 93.1 | 100 | — | 98 | — | — | |
| DRAEMSupervision=Unsupervised, Backbone=reconstructive encoder, Resolution=256x2562022.12 | — | — | 96.9 | 99.9 | 100 | 100 | 99.5 | — | 98 | 90.9 | 91.3 | 100 | 100 | 97.1 | 98.7 | 100 | 91.7 | 100 | — | 97.6 | — | — | |
| EdgRec2022.10 | — | 97.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GANomaly (GN)Image Size=2562022.01 | — | — | 69.9 | 70.8 | 84.2 | 79.4 | 83.4 | 77.5 | 89.2 | 75.7 | 73.2 | 78.5 | 70 | 74.3 | 74.6 | 65.3 | 79.2 | 74.5 | 75.5 | 76.2 | — | — | |
| GTImage Size=2562022.01 | — | — | 43.7 | 61.9 | 84.1 | 41.7 | 61.1 | 58.5 | 74.4 | 78.3 | 67 | 35.9 | 81.3 | 63 | 50 | 97.2 | 86.9 | 82 | 71.6 | 67.2 | — | — | |
| Intra2022.10 | — | 95.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ITAE2022.10 | — | 83.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| KDADSupervision=Unsupervised, Resolution=256x2562022.12 | — | — | 80.3 | 75.3 | 92.3 | 91.5 | 94.5 | — | 99.2 | 90.3 | 81.4 | 98.8 | 77.1 | 84.4 | 82.4 | 97.1 | 84.9 | 93.7 | — | 88.2 | — | — |