Binary Classification on MMAD
97.62Average ScoreAgentIAD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AgentIADScale=3B2025.12 | 97.62 | 97.84 | 98.54 | 95.57 | 97.9 | |
| OmniADScale=7B, Model Category=Fine-tuned Models, Evaluation Protocol=1-shot2025.12 | 90.53 | 96 | 86.6 | 91.1 | 88.4 | |
| AD-FMScale=7B, Model Category=Fine-tuned Models2025.12 | 73.15 | 90.72 | 79.52 | 65.62 | 56.74 | |
| GPT-4.1Model Category=Proprietary Models2025.12 | 71.6 | 78.83 | 80.99 | 69.35 | 57.21 | |
| UniVADModel Category=CLIP-based Models, Evaluation Protocol=1-shot2025.12 | 69.7 | 82.7 | 75.5 | 64.1 | 56.5 | |
| GPT-4oModel Category=Proprietary Models2025.12 | 68.63 | — | — | — | — | |
| AdaCLIPModel Category=CLIP-based Models, Evaluation Protocol=0-shot2025.12 | 67.1 | 73.8 | 75.5 | 63.2 | 56.2 | |
| InternVL3Scale=38B, Model Category=Open-Source Models2025.12 | 66.56 | 78.12 | 68.75 | 63.86 | 55.49 | |
| AnomalyCLIPModel Category=CLIP-based Models, Evaluation Protocol=0-shot2025.12 | 65.7 | 79.9 | 64.5 | 63.2 | 55.4 | |
| GPT-4o-miniModel Category=Proprietary Models2025.12 | 64.33 | — | — | — | — | |
| InternVL2Scale=76B, Model Category=Open-Source Models2025.12 | 64.11 | 79.42 | 69.78 | 54.02 | 53.2 | |
| InternVL3Scale=8B, Model Category=Open-Source Models2025.12 | 63.38 | 78.53 | 65.02 | 59.77 | 50.2 | |
| AA-CLIPModel Category=CLIP-based Models, Evaluation Protocol=0-shot2025.12 | 62.8 | 77.6 | 54.2 | 63.1 | 56.5 | |
| LLaVA-NeXTScale=34B, Model Category=Open-Source Models2025.12 | 61.92 | 72.44 | 55.91 | 63.28 | 56.06 | |
| AnomalyGPTModel Category=CLIP-based Models, Evaluation Protocol=0-shot2025.12 | 61.9 | 72.8 | 56.5 | 63 | 55.3 | |
| WinCLIPModel Category=CLIP-based Models, Evaluation Protocol=0-shot2025.12 | 61 | 65.8 | 62.2 | 63.2 | 53 | |
| AnomalyR1Scale=3B, Model Category=Fine-tuned Models2025.12 | 60.62 | 65.07 | 69.03 | 56.3 | 52.08 | |
| QwenVL2.5Scale=7B, Model Category=Open-Source Models2025.12 | 56.14 | 58 | 59.92 | 40.8 | 58 | |
| QwenVL2.5Scale=3B, Model Category=Open-Source Models2025.12 | 47.98 | 49.73 | 54.93 | 39.27 | 46.56 |