Multimodal Anomaly Detection on MMAD 1-shot
95.24Anomaly DiscriminationHuman (expert)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Human (expert)Scale=-2026.05 | 95.24 | 75 | 92.31 | 83.33 | 94.2 | 86.11 | 80.37 | 86.65 | |
| Gemini-2.5-flashScale=-2026.05 | 93.38 | 69.88 | 63.3 | 76.41 | 81.57 | 94.04 | 82 | 80.08 | |
| Human (ordinary)Scale=-2026.05 | 86.9 | 66.25 | 85.58 | 71.25 | 81.52 | 89.58 | 69.72 | 78.69 | |
| Gemini-2.5-proScale=-2026.05 | 83.07 | 73.86 | 67.2 | 79.97 | 86.27 | 94.88 | 83.08 | 81.19 | |
| Kimi-VL-A3BScale=16B2026.05 | 72.93 | 53.49 | 59.66 | 72.39 | 81.74 | 91.91 | 85.89 | 74 | |
| Qwen2.5-VLScale=7B2026.05 | 71.39 | 54.35 | 61.17 | 65.81 | 79.32 | 91.44 | 84.43 | 72.56 | |
| Gemini-1.5-proScale=-2026.05 | 68.63 | 60.12 | 58.56 | 70.38 | 82.46 | 89.2 | 82.25 | 73.09 | |
| GPT-4oScale=-2026.05 | 68.63 | 65.8 | 55.62 | 73.21 | 83.41 | 94.98 | 82.8 | 74.92 | |
| InternVL3.5Scale=8B2026.05 | 67.5 | 49.37 | 57.9 | 58.07 | 77.66 | 72.01 | 81.11 | 66.3 | |
| JUDOScale=7B2026.05 | 65.04 | 74.74 | 73.01 | 84.56 | 89.41 | 94.04 | 87.58 | 81.2 | |
| GPT-5-miniScale=-2026.05 | 64.1 | 67.35 | 69.07 | 79.02 | 86.72 | 93.96 | 83.37 | 77.65 | |
| AnomalyR1Scale=7B2026.05 | 60.93 | 64.81 | 70.72 | 79.06 | 85.52 | 93.12 | 86.91 | 77.29 | |
| Claude-3.5-sonnetScale=-2026.05 | 60.14 | 60.14 | 48.81 | 67.13 | 79.11 | 85.19 | 79.83 | 68.36 | |
| MiMo-VLScale=8B2026.05 | 54.45 | 59.56 | 60.77 | 71.5 | 78.48 | 90.56 | 81.6 | 70.99 | |
| LLaVA-OneVisionScale=7B2026.05 | 51.77 | 46.13 | 41.85 | 62.19 | 69.73 | 90.31 | 80.93 | 63.27 | |
| Random ChanceScale=-2026.05 | 50 | 25 | 25 | 25 | 25 | 25 | 25 | 28.57 |