Anomaly Detection on SDD (test)
98.8AUC-ROCDevNet
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DevNetlabeled anomaly examples=102021.08 | 98.8 | — | — | |
| FLOSlabeled anomaly examples=102021.08 | 96.7 | — | — | |
| DeepSADlabeled anomaly examples=102021.08 | 96.3 | — | — | |
| MINNSlabeled anomaly examples=102021.08 | 96.1 | — | — | |
| KDADlabeled anomaly examples=102021.08 | 88.8 | — | — | |
| IAD-R1(Qwen2.5-VL)Param.=7B, Anno.=T+I2026.03 | 85.4 | — | 90.8 | |
| AnomalyCLIPCategory=Obj, |C|=1, Backbone=ViT-L/14@336px2023.10 | 84.7 | 80 | — | |
| Qwen2.5-VLParam.=72B, Anno.=/2026.03 | 84.5 | — | 95.6 | |
| GPT-4.1Param.=/, Anno.=/2026.03 | 84.4 | — | 92.1 | |
| WinCLIPCategory=Obj, |C|=12023.10 | 84.3 | 77.4 | — | |
| MRAD-CLIPTraining Setting=Training-Based, Zero-shot=true2026.01 | 83.9 | 76.2 | — | |
| MRAD-FTTraining Setting=Training-Based, Zero-shot=true2026.01 | 83.8 | 75.8 | — | |
| FAPromptTraining Setting=Training-Based, Zero-shot=true2026.01 | 83.4 | 75.3 | — | |
| IAD-R1(Qwen2.5-VL)Param.=3B, Anno.=T+I2026.03 | 83.4 | — | 89.1 | |
| AnomalyCLIPTraining Setting=Training-Based, Zero-shot=true2026.01 | 82.7 | 73.8 | — | |
| GPT-5-nanoParam.=/, Anno.=/2026.03 | 82.6 | — | 88.6 | |
| InternVL-3Param.=78B, Anno.=/2026.03 | 82.5 | — | 88.6 | |
| Qwen2.5-VLParam.=32B, Anno.=/2026.03 | 82.4 | — | 90.1 | |
| Qwen2.5-VL+CGRO*Param.=7B, Anno.=I, ReAL=true2026.03 | 81.4 | — | 97 | |
| MRAD-TFTraining Setting=Train-Free, Zero-shot=true2026.01 | 80 | 66.3 | — | |
| VANDCategory=Obj, |C|=12023.10 | 79.8 | 71.4 | — | |
| TriadParam.=7B, Anno.=T+I2026.03 | 79.8 | — | 68.1 | |
| AdaCLIPTraining Setting=Training-Based, Zero-shot=true2026.01 | 77.5 | 65.7 | — | |
| GPT-4oParam.=/, Anno.=/2026.03 | 77.5 | — | 90.7 | |
| Qwen2.5-VL+R1*Param.=7B, Anno.=I, ReAL=true2026.03 | 77.3 | — | 97.2 | |
| CoOpCategory=Obj, |C|=12023.10 | 74.9 | 65.1 | — | |
| AnomalyGPTParam.=7B, Anno.=T+I+P2026.03 | 72.7 | — | 13 | |
| Gemini-2.5-FlashParam.=/, Anno.=/2026.03 | 71.8 | — | 49.5 | |
| Qwen3VL-thinkingParam.=8B, Anno.=/2026.03 | 70.5 | — | 52.1 | |
| MiniCPM-V-2.6Param.=8B, Anno.=/2026.03 | 70.2 | — | 97.1 | |
| Qwen3VL-thinking-A3BParam.=30B, Anno.=/2026.03 | 69.5 | — | 55.3 | |
| DSVDDlabeled anomaly examples=102021.08 | 68.2 | — | — | |
| LLaVA-OneVision-OVParam.=7B, Anno.=/2026.03 | 68.1 | — | 94.7 | |
| Qwen2.5-VL+CGRO*Param.=3B, Anno.=I, ReAL=true2026.03 | 67.9 | — | 82.5 | |
| LLaVA-1.6Param.=7B, Anno.=/2026.03 | 67 | — | 50.4 | |
| GPT-4o-miniParam.=/, Anno.=/2026.03 | 66.2 | — | 92.8 | |
| CLIPCategory=Obj, |C|=12023.10 | 65.7 | 45.2 | — | |
| LLaVA-OneVision-SIParam.=7B, Anno.=/2026.03 | 65.5 | — | 67.8 | |
| CLIP-ACCategory=Obj, |C|=12023.10 | 65.2 | 45.7 | — | |
| Qwen2.5-VLParam.=7B, Anno.=/2026.03 | 65 | — | 93.8 | |
| InternVL-2.5Param.=8B, Anno.=/2026.03 | 63.7 | — | 96.3 | |
| WinCLIPTraining Setting=Train-Free, Zero-shot=true2026.01 | 54.8 | 37.7 | — | |
| Qwen2.5-VL+R1*Param.=3B, Anno.=I, ReAL=true2026.03 | 54.1 | — | 94.8 | |
| EIADParam.=7B, Anno.=T+I2026.03 | 52.7 | — | 87.2 | |
| Qwen2.5-VLParam.=3B, Anno.=/2026.03 | 46.3 | — | 69.9 |