Anomaly Detection on MVTec-LOCO 1.0 (test)
95.3ROC-AUC (Total)CSAD
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CSADComponent Segmentation=Unsupervised, Throughput=321.8, Latency (ms)=8.92024.08 | 95.3 | 96.7 | 94 | 94.4 | 94.9 | 99.5 | 99.9 | 94.8 | 91.1 | 95.6 | 97.8 | 93.2 | 92.2 | |
| PSADComponent Segmentation=Supervised, Throughput=10.2, Latency (ms)=97.8, Note=Throughput measured with batch size 12024.08 | 94.8 | 98.1 | 91.6 | 100 | 99.1 | 100 | 99.3 | 91.9 | 84.9 | 98.2 | 89.8 | 95.7 | 89.3 | |
| EfficientADComponent Segmentation=No Segmentation, Throughput=2369.8, Latency (ms)=1.92024.08 | 90.7 | 86.8 | 94.7 | 85.5 | 98.4 | 97.7 | 56.7 | 95.5 | 88.4 | 99.7 | 96.1 | 90.7 | 98.5 | |
| SAM-LADResolution=224x224, k-nearest=22024.06 | 90.7 | 95.8 | 85.5 | — | — | — | — | — | — | — | — | — | — | |
| ASTComAD=true2023.05 | 90.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ComADComponent Segmentation=Unsupervised, Throughput=69.9, Latency (ms)=19.52024.08 | 90.1 | 89.4 | 90.9 | 91.1 | 95 | 95.7 | 71.9 | 93.3 | 81.6 | 98.2 | 91.1 | 88.5 | 94.9 | |
| EfficientAD-S2024.06 | 90 | 94.1 | 85.8 | — | — | — | — | — | — | — | — | — | — | |
| PatchCoreComAD=true2023.05 | 89.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RD4ADComAD=true2023.05 | 87.3 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SINBAD2023.02 | 86.8 | 88.9 | 84.7 | 96.5 | 96.6 | 83.4 | 78.6 | 89.3 | 87.5 | 93.1 | 74.2 | 92.2 | 76.7 | |
| DRAEMComAD=true2023.05 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | |
| THFR2024.06 | 86 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DSKD2024.06 | 84 | 81.2 | 86.9 | — | — | — | — | — | — | — | — | — | — | |
| DADFBackbone=Wide-Resnet502023.03 | 83.7 | 79.2 | 88.2 | — | — | — | — | — | — | — | — | — | — | |
| ASTComponent Segmentation=No Segmentation, Throughput=28.2, Latency (ms)=58.72024.08 | 83.7 | 79.7 | 87.7 | 80 | 91.6 | 65.1 | 80.1 | 81.8 | 79.9 | 95.5 | 77.8 | 95.9 | 89.4 | |
| GCAD2023.02 | 83.4 | 86 | 80.7 | 87 | 100 | 97.5 | 56 | 89.7 | 80.9 | 98.9 | 74.9 | 70.5 | 78.3 | |
| GCAD2023.03 | 83.4 | 86 | 80.7 | — | — | — | — | — | — | — | — | — | — | |
| GCAD2024.06 | 83.4 | 86 | 80.7 | — | — | — | — | — | — | — | — | — | — | |
| GLCF2024.06 | 83.1 | 82.4 | 83.8 | — | — | — | — | — | — | — | — | — | — | |
| PNPTLearning paradigm=Explicit normality learning2024.06 | 81.9 | 79.5 | 84.3 | — | — | — | — | — | — | — | — | — | — | |
| PatchCoreComponent Segmentation=No Segmentation, Throughput=109.9, Latency (ms)=17.32024.08 | 81.6 | 73.9 | 89.3 | 74.8 | 93.9 | 63.6 | 57.8 | 79.2 | 80.1 | 98.5 | 87.9 | 92 | 88 | |
| UniADLearning paradigm=Implicit normality learning, Publication venue=NeurIPS 222024.06 | 80.2 | 78.8 | 81.6 | — | — | — | — | — | — | — | — | — | — | |
| ASTComAD=false2023.05 | 79.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RD4AD2023.03 | 78.7 | 69.4 | 88 | — | — | — | — | — | — | — | — | — | — | |
| CDOLearning paradigm=Implicit normality learning, Publication venue=TII 232024.06 | 78.1 | 69.7 | 86.6 | — | — | — | — | — | — | — | — | — | — | |
| SimpleNetComponent Segmentation=No Segmentation, Throughput=114.3, Latency (ms)=19.62024.08 | 77.6 | 71.5 | 83.7 | 77.1 | 87.8 | 69 | 51.6 | 72 | 80.9 | 90.4 | 81.6 | 83.3 | 82.6 | |
| ST2023.02 | 77.4 | 66.4 | 88.3 | 68.9 | 82.9 | 59.5 | 55.5 | 65.4 | 68.4 | 99.3 | 90.3 | 87 | 96.8 | |
| S-T2023.03 | 77.4 | 66.4 | 88.3 | — | — | — | — | — | — | — | — | — | — | |
| PatchCore2023.03 | 75.5 | 69 | 82 | — | — | — | — | — | — | — | — | — | — | |
| PatchCoreComAD=false2023.05 | 75.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| PatchcoreLearning paradigm=Explicit normality learning, Publication venue=CVPR 222024.06 | 75.4 | 73 | 77.8 | — | — | — | — | — | — | — | — | — | — | |
| PCore2023.02 | 74 | 69 | 78.9 | 77.7 | 83.7 | 62.2 | 55.3 | 63.3 | 74.8 | 86.7 | 77.6 | 86.6 | 68.7 | |
| SPADE2023.03 | 74 | 69 | 78.9 | — | — | — | — | — | — | — | — | — | — | |
| RD4ADLearning paradigm=Implicit normality learning, Publication venue=CVPR 222024.06 | 73.7 | 65 | 82.5 | — | — | — | — | — | — | — | — | — | — | |
| DRAEM2023.03 | 73.6 | 72.8 | 74.4 | — | — | — | — | — | — | — | — | — | — | |
| DRAEMComAD=false2023.05 | 72 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPADELearning paradigm=Explicit normality learning, Publication venue=Arxiv2024.06 | 70.9 | 74.5 | 67.3 | — | — | — | — | — | — | — | — | — | — | |
| RD4ADComAD=false2023.05 | 70.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SPADE2023.02 | 68.9 | 71 | 66.9 | 81.8 | 91.9 | 60.5 | 46.8 | 73.8 | 74.7 | 84.9 | 58.1 | 59.8 | 57.1 | |
| PadimLearning paradigm=Explicit normality learning, Publication venue=ICPR 212024.06 | 67.1 | 62.3 | 71.8 | — | — | — | — | — | — | — | — | — | — | |
| MNAD2023.02 | 65.1 | 60.1 | 70.2 | 59.9 | 70.5 | 51.7 | 60.8 | 57.6 | 60.2 | 84.1 | 76.7 | 56.8 | 73.2 | |
| MNAD2023.03 | 65.1 | 60.1 | 70.2 | — | — | — | — | — | — | — | — | — | — | |
| MNAD2024.06 | 65.1 | 60.1 | 70.2 | — | — | — | — | — | — | — | — | — | — | |
| f-AG2023.02 | 64.3 | 65.9 | 62.7 | 69.4 | 82.4 | 59.1 | 49.7 | 68.8 | 50.7 | 77.8 | 74.9 | 46.1 | 63.8 | |
| f-AnoGAN2024.06 | 64.3 | 65.9 | 62.7 | — | — | — | — | — | — | — | — | — | — | |
| DraemLearning paradigm=Implicit normality learning, Publication venue=ICCV 212024.06 | 63 | 56 | 70 | — | — | — | — | — | — | — | — | — | — | |
| VM2023.02 | 57.7 | 56.5 | 58.9 | 70.3 | 59.7 | 42.5 | 45.3 | 64.9 | 70.1 | 69.4 | 65.8 | 37.7 | 51.6 | |
| AE2023.02 | 57.4 | 58.2 | 56.6 | 58 | 67.9 | 62 | 46.8 | 56.2 | 47.7 | 62.6 | 66.4 | 41.5 | 64.8 | |
| AE2023.03 | 57.4 | 58.2 | 56.6 | — | — | — | — | — | — | — | — | — | — | |
| AE2024.06 | 57.4 | 58.2 | 56.6 | — | — | — | — | — | — | — | — | — | — | |
| VAE2023.02 | 54.3 | 53.8 | 54.8 | 47.3 | 61.3 | 54.3 | 47 | 59.4 | 38.3 | 57.3 | 75.1 | 49 | 54.6 | |
| VAE2023.03 | 54.3 | 55.6 | 52.9 | — | — | — | — | — | — | — | — | — | — | |
| VAE2024.06 | 54.3 | 53.8 | 54.8 | — | — | — | — | — | — | — | — | — | — |