Anomaly Detection on AITEX
0.893Mean AUC-ROCDRA
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DRAC (number of anomaly classes)=12, Training setting=ten random anomaly examples2022.03 | 0.893 | — | — | — | — | — | — | — | — | — | |
| DRAtraining_anomaly_examples=10, anomaly_classes=122022.03 | 0.893 | — | — | — | — | — | — | — | — | — | |
| DevNettraining_anomaly_examples=10, anomaly_classes=122022.03 | 0.887 | — | — | — | — | — | — | — | — | — | |
| SAOEtraining_anomaly_examples=10, anomaly_classes=122022.03 | 0.874 | — | — | — | — | — | — | — | — | — | |
| MLEPtraining_anomaly_examples=10, anomaly_classes=122022.03 | 0.867 | — | — | — | — | — | — | — | — | — | |
| FLOStraining_anomaly_examples=10, anomaly_classes=122022.03 | 0.841 | — | — | — | — | — | — | — | — | — | |
| MINNSC (number of anomaly classes)=12, Training setting=ten random anomaly examples2022.03 | 0.813 | — | — | — | — | — | — | — | — | — | |
| InCTRLSetup=8-shot2024.03 | 0.806 | — | — | — | — | — | — | — | — | — | |
| WinCLIPSetup=8-shot2024.03 | 0.796 | — | — | — | — | — | — | — | — | — | |
| PaDiMSetup=8-shot2024.03 | 0.792 | — | — | — | — | — | — | — | — | — | |
| InCTRLSetup=4-shot2024.03 | 0.79 | — | — | — | — | — | — | — | — | — | |
| PaDiMSetup=4-shot2024.03 | 0.787 | — | — | — | — | — | — | — | — | — | |
| PaDiMSetup=2-shot2024.03 | 0.784 | — | — | — | — | — | — | — | — | — | |
| CoOpSetup=8-shot2024.03 | 0.769 | — | — | — | — | — | — | — | — | — | |
| DRAtraining_anomaly_examples=10, known_anomaly_class=Mean2022.03 | 0.766 | — | — | — | — | — | — | — | — | — | |
| WinCLIPSetup=4-shot2024.03 | 0.764 | — | — | — | — | — | — | — | — | — | |
| InCTRLSetup=2-shot2024.03 | 0.761 | — | — | — | — | — | — | — | — | — | |
| PatchCoreSetup=8-shot2024.03 | 0.745 | — | — | — | — | — | — | — | — | — | |
| PatchCoreSetup=2-shot2024.03 | 0.739 | — | — | — | — | — | — | — | — | — | |
| WinCLIPSetup=0-shot2024.03 | 0.733 | — | — | — | — | — | — | — | — | — | |
| PatchCoreSetup=4-shot2024.03 | 0.733 | — | — | — | — | — | — | — | — | — | |
| SPADESetup=2-shot2024.03 | 0.727 | — | — | — | — | — | — | — | — | — | |
| WinCLIPSetup=2-shot2024.03 | 0.726 | — | — | — | — | — | — | — | — | — | |
| CoOpSetup=4-shot2024.03 | 0.72 | — | — | — | — | — | — | — | — | — | |
| SPADESetup=4-shot2024.03 | 0.718 | — | — | — | — | — | — | — | — | — | |
| SPADESetup=8-shot2024.03 | 0.708 | — | — | — | — | — | — | — | — | — | |
| DRAtraining_anomaly_examples=1, anomaly_classes=122022.03 | 0.692 | — | — | — | — | — | — | — | — | — | |
| CoOpSetup=2-shot2024.03 | 0.687 | — | — | — | — | — | — | — | — | — | |
| DeepSADC (number of anomaly classes)=12, Training setting=ten random anomaly examples2022.03 | 0.686 | — | — | — | — | — | — | — | — | — | |
| DRAtraining_anomaly_examples=1, known_anomaly_class=Mean2022.03 | 0.684 | — | — | — | — | — | — | — | — | — | |
| DevNetOpen-set setting=true2021.08 | 0.683 | 0.658 | 0.585 | 0.709 | 0.734 | 0.81 | 0.599 | — | — | — | |
| SAOEtraining_anomaly_examples=1, anomaly_classes=122022.03 | 0.675 | — | — | — | — | — | — | — | — | — | |
| FLOSOpen-set setting=true2021.08 | 0.635 | 0.585 | 0.548 | 0.745 | 0.55 | 0.746 | 0.636 | — | — | — | |
| MINNSOpen-set setting=true2021.08 | 0.632 | 0.708 | 0.565 | 0.734 | 0.534 | 0.707 | 0.544 | — | — | — | |
| RegADSetup=8-shot2024.03 | 0.603 | — | — | — | — | — | — | — | — | — | |
| DevNettraining_anomaly_examples=1, anomaly_classes=122022.03 | 0.598 | — | — | — | — | — | — | — | — | — | |
| RegADSetup=4-shot2024.03 | 0.596 | — | — | — | — | — | — | — | — | — | |
| KDADOpen-set setting=true2021.08 | 0.58 | 0.552 | 0.705 | 0.567 | 0.559 | 0.566 | 0.529 | — | — | — | |
| KDADtraining_protocol=Unsupervised, known_anomaly_class=Mean2022.03 | 0.58 | — | — | — | — | — | — | — | — | — | |
| KDADtraining_anomaly_examples=Unsupervised, anomaly_classes=122022.03 | 0.576 | — | — | — | — | — | — | — | — | — | |
| MLEPtraining_anomaly_examples=1, anomaly_classes=122022.03 | 0.564 | — | — | — | — | — | — | — | — | — | |
| RegADSetup=2-shot2024.03 | 0.564 | — | — | — | — | — | — | — | — | — | |
| DeepSADOpen-set setting=true2021.08 | 0.557 | 0.442 | 0.614 | 0.523 | 0.518 | 0.733 | 0.51 | — | — | — | |
| FLOStraining_anomaly_examples=1, anomaly_classes=122022.03 | 0.538 | — | — | — | — | — | — | — | — | — | |
| AHLNumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.925 | — | — | |
| AHLNumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.734 | — | — | |
| AHLFew-shot setup=A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.707 | 0.763 | |
| AHLFew-shot setup=A4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.751 | 0.788 | |
| DevNetNumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.887 | — | — | |
| DevNetNumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.598 | — | — | |
| DPDLNumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.975 | — | — | |
| DPDLNumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.838 | — | — | |
| DRANumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.893 | — | — | |
| DRANumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.692 | — | — | |
| DRAFew-shot setup=A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.723 | 0.753 | |
| DRAFew-shot setup=A4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.757 | 0.778 | |
| FLOSNumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.841 | — | — | |
| FLOSNumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.538 | — | — | |
| FoundADFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.714 | 0.804 | |
| FoundADFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.723 | 0.814 | |
| FoundADFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.732 | 0.828 | |
| FoundADFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.743 | 0.83 | |
| IDEALFew-shot setup=N1A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.758 | 0.827 | |
| IDEALFew-shot setup=N2A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.776 | 0.853 | |
| IDEALFew-shot setup=N4A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.795 | 0.861 | |
| IDEALFew-shot setup=N8A4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.839 | 0.868 | |
| InCTRLFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.749 | 0.783 | |
| InCTRLFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.752 | 0.787 | |
| InCTRLFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.756 | 0.804 | |
| InCTRLFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.759 | 0.806 | |
| MLEPNumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.867 | — | — | |
| MLEPNumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.564 | — | — | |
| NAGLFew-shot setup=N1A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.716 | 0.755 | |
| NAGLFew-shot setup=N2A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.735 | 0.798 | |
| NAGLFew-shot setup=N4A1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.756 | 0.809 | |
| NAGLFew-shot setup=N8A4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.805 | 0.823 | |
| PromptADFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.719 | 0.814 | |
| PromptADFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.738 | 0.818 | |
| PromptADFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.741 | 0.834 | |
| PromptADFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.744 | 0.847 | |
| RegADFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.72 | 0.802 | |
| RegADFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.735 | 0.82 | |
| RegADFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.746 | 0.837 | |
| RegADFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.758 | 0.839 | |
| ResADFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.705 | 0.727 | |
| ResADFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.75 | 0.751 | |
| ResADFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.752 | 0.767 | |
| ResADFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.754 | 0.793 | |
| SAOENumber of training anomaly examples=102025.02 | — | — | — | — | — | — | — | 0.874 | — | — | |
| SAOENumber of training anomaly examples=12025.02 | — | — | — | — | — | — | — | 0.675 | — | — | |
| WinCLIPFew-shot setup=N1, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.731 | 0.789 | |
| WinCLIPFew-shot setup=N2, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.735 | 0.793 | |
| WinCLIPFew-shot setup=N4, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.738 | 0.795 | |
| WinCLIPFew-shot setup=N8, Backbone=ViT-S/14, Resolution=448 x 4482026.05 | — | — | — | — | — | — | — | — | 0.748 | 0.805 |