Image Anomaly Detection on MVTec AD
100Carpet I-AUROCRD++
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RD++Method Framework Type=Synthesis-based2024.12 | 100 | 100 | 100 | 99.7 | 99.3 | 100 | 99.3 | 99 | 100 | 100 | 98.4 | 98.9 | 100 | 98.5 | 98.6 | 99.4 | — | — | — | |
| PBASMethod Framework Type=Synthesis-based2024.12 | 100 | 100 | 100 | 100 | 99.8 | 100 | 99.8 | 99.7 | 100 | 99.9 | 98.7 | 98.5 | 100 | 100 | 100 | 99.8 | — | — | — | |
| CutPaste2023.09 | 100 | 99.1 | 100 | 99.8 | 99.8 | 100 | 96.2 | 95.4 | 99.9 | 98.6 | 93.3 | 86.6 | 90.7 | 97.5 | 99.9 | 97.1 | — | 99.7 | 95.8 | |
| DSR2023.09 | 100 | 100 | 100 | 100 | 96.3 | 100 | 93.8 | 98.1 | 95.6 | 98.5 | 97.5 | 96.2 | 99.7 | 97.8 | 100 | 98.2 | — | 99.3 | 97.7 | |
| CRASAnomaly Synthesis=Yes, Taxonomy=Embedding-based, Protocol=Multi-class, Backbone=WideResNet50, Input Resolution=288x288, Batch size=322025.05 | 99.8 | 99.8 | 100 | 99.8 | 99.6 | 100 | 99.6 | 96.2 | 99.8 | 99.6 | 96.3 | 100 | 100 | 100 | 99.7 | 98.3 | — | — | — | |
| SimpleNetMethod Framework Type=Synthesis-based2024.12 | 99.7 | 99.9 | 100 | 98.7 | 99.5 | 100 | 100 | 97.8 | 99.8 | 100 | 98.6 | 98.7 | 100 | 100 | 99.9 | 99.5 | — | — | — | |
| FAIR2023.09 | 99.7 | 99.7 | 100 | 100 | 100 | 100 | 98.1 | 97 | 99.2 | 98 | 99 | 91.6 | 100 | 98.6 | 98.5 | 98.6 | — | 99.9 | 98 | |
| DSRMethod Framework Type=Synthesis-based2024.12 | 99.6 | 100 | 99.3 | 100 | 94.7 | 99.6 | 95.3 | 98.3 | 97.7 | 99.1 | 98.9 | 95.9 | 100 | 96.3 | 98.5 | 98.2 | — | — | — | |
| RD4ADAnomaly Synthesis=No, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 99.5 | 98.2 | 100 | 98.9 | 99.2 | 56.5 | 96.5 | 90.3 | 100 | 100 | 94.4 | 91.8 | 98.6 | 95.4 | 97.3 | 94.4 | — | — | — | |
| DeSTSegMethod Framework Type=Synthesis-based2024.12 | 99.3 | 98.6 | 100 | 100 | 99.7 | 100 | 97.3 | 97.8 | 100 | 99.2 | 97.1 | 88.3 | 100 | 99.8 | 100 | 98.5 | — | — | — | |
| NoCoADMethod Framework Type=Embedding-based2024.12 | 99.1 | 98.8 | 100 | 100 | 99.4 | 100 | 95.2 | 94.9 | 100 | 99.7 | 96.6 | 95.3 | 97.2 | 93 | 97.2 | 97.7 | — | — | — | |
| DBPIMethod Framework Type=Synthesis-based2024.12 | 99 | 98.4 | 100 | 100 | 99.6 | 99.4 | 95.9 | 97.1 | 98.8 | 100 | 95.2 | 98.1 | 100 | 99.7 | 93.8 | 98.3 | — | — | — | |
| PBASAnomaly Synthesis=Yes, Taxonomy=Embedding-based, Protocol=Multi-class2025.05 | 98.9 | 66.3 | 100 | 98 | 99.6 | 99.6 | 94.4 | 72.2 | 98.4 | 91.6 | 84.2 | 96.3 | 82.8 | 81.5 | 96.5 | 91.1 | — | — | — | |
| Intra2023.09 | 98.8 | 100 | 100 | 98.2 | 98 | 100 | 84.2 | 86.5 | 95.7 | 96.9 | 90.2 | 95.7 | 99.7 | 95.8 | 99.4 | 95.9 | — | 99 | 94.4 | |
| RD4ADMethod Framework Type=Embedding-based2024.12 | 98.7 | 100 | 100 | 99.3 | 99.2 | 99.9 | 97 | 98.2 | 100 | 100 | 96.8 | 97.8 | 99.7 | 96.8 | 98 | 98.8 | — | — | — | |
| UniADAnomaly Synthesis=Yes, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 98.3 | 92.1 | 97.8 | 96.8 | 98.9 | 99.4 | 94.4 | 98.4 | 96.9 | 96.4 | 79.6 | 90.9 | 98.3 | 97.7 | 88.5 | 96.5 | — | — | — | |
| PNPTAnomaly Synthesis=No, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 98 | 98.3 | 98.5 | 97 | 98.1 | 98.5 | 96.6 | 91.8 | 98.5 | 98.1 | 94.2 | 94.4 | 98.5 | 98.2 | 95.9 | 97 | — | — | — | |
| SimpleNetAnomaly Synthesis=Yes, Taxonomy=Embedding-based, Protocol=Multi-class2025.05 | 98 | 65.2 | 96.6 | 91.1 | 95 | 99.9 | 96.5 | 86.7 | 100 | 73.7 | 83.9 | 84.4 | 89.9 | 78.6 | 96.2 | 87 | — | — | — | |
| GLASSAnomaly Synthesis=Yes, Taxonomy=Embedding-based, Protocol=Multi-class2025.05 | 97.4 | 81 | 94.6 | 83.1 | 84.9 | 92.1 | 88.5 | 85.5 | 97.9 | 77.1 | 87.9 | 84.3 | 70 | 78.4 | 97 | 89.7 | — | — | — | |
| DRAEM2023.09 | 97 | 99.9 | 100 | 99.6 | 99.1 | 99.2 | 91.8 | 98.5 | 100 | 98.7 | 98.9 | 93.9 | 100 | 93.1 | 100 | 98 | — | 99.1 | 97.4 | |
| DRAEMMethod Framework Type=Synthesis-based2024.12 | 96.3 | 100 | 100 | 100 | 99.2 | 96.9 | 93.4 | 96.1 | 100 | 99.4 | 96.8 | 99.2 | 99.7 | 94.2 | 99.7 | 98.1 | — | — | — | |
| Pull&PushMethod Framework Type=Embedding-based2024.12 | 95.9 | 99.9 | 63.6 | 99.7 | 99.6 | 99.9 | 98.4 | 99.8 | 99.5 | 86.9 | 99.7 | 85.3 | 94 | 100 | 99.6 | 94.8 | — | — | — | |
| NSA2023.09 | 95.6 | 99.9 | 99.9 | 100 | 97.5 | 97.7 | 94.5 | 95.2 | 94.7 | 98.7 | 99.2 | 90.2 | 100 | 95.1 | 99.8 | 97.2 | — | 98.6 | 96.5 | |
| CFAMethod Framework Type=Embedding-based2024.12 | 94.7 | 99.7 | 98.6 | 99.9 | 97.4 | 100 | 99.4 | 99.9 | 99.6 | 96.5 | 98.5 | 98.3 | 100 | 99.4 | 88.8 | 98.1 | — | — | — | |
| CutPasteMethod Framework Type=Embedding-based2024.12 | 93.9 | 100 | 100 | 94.6 | 99.1 | 98.2 | 81.2 | 98.2 | 98.3 | 99.9 | 94.9 | 88.7 | 99.4 | 96.1 | 99.9 | 96.2 | — | — | — | |
| Patch-SVDD2023.09 | 92.9 | 94.7 | 90.9 | 97.8 | 96.5 | 98.6 | 90.3 | 76.7 | 92 | 94 | 86.1 | 81.3 | 100 | 91.5 | 97.9 | 92.1 | — | 94.5 | 90.8 | |
| OneNIPAnomaly Synthesis=Yes, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 92.1 | 94.4 | 100 | 88.9 | 93.5 | 96.9 | 91.3 | 96.8 | 97 | 91.7 | 97.6 | 97.6 | 98.6 | 96.5 | 99 | 91.2 | — | — | — | |
| DSRAnomaly Synthesis=Yes, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 89.7 | 98.3 | 92.1 | 89.2 | 91.3 | 99.9 | 96.5 | 91.8 | 83.9 | 94.7 | 79.8 | 80.1 | 92.5 | 66.5 | 77.3 | 88.3 | — | — | — | |
| DRAEMAnomaly Synthesis=Yes, Taxonomy=Reconstruction-based, Protocol=Multi-class2025.05 | 87.8 | 57.1 | 83.5 | 74.2 | 85.3 | 71.9 | 51.9 | 74.7 | 62.4 | 84 | 38 | 27.3 | 75.8 | 68.8 | 66 | 81.2 | — | — | — | |
| RIAD2023.09 | 84.2 | 99.6 | 100 | 93.4 | 93 | 99.9 | 81.9 | 88.4 | 83.3 | 88.5 | 83.8 | 84.5 | 100 | 90.9 | 98.1 | 91.7 | — | 95.1 | 89.9 | |
| CFAAnomaly Synthesis=No, Taxonomy=Embedding-based, Protocol=Multi-class2025.05 | 73 | 38.6 | 78.4 | 55.3 | 68.3 | 59.2 | 63.4 | 60.2 | 64.3 | 72 | 68.6 | 48 | 52.5 | 54.5 | 43.7 | 60 | — | — | — | |
| PFlowAnomaly Synthesis=No, Taxonomy=Embedding-based, Protocol=Multi-class2025.05 | 56.7 | 82.3 | 77 | 96.6 | 99.6 | 99.4 | 70.3 | 70.1 | 93.4 | 72.8 | 80.9 | 65.7 | 60.6 | 82.6 | 82.6 | 79.4 | — | — | — |