Industrial Anomaly Detection on MMAD one-shot 1.0 (test)
95.24Anomaly Discrimination ScoreHuman (expert)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Human (expert)Type=Human2026.02 | 95.24 | 75 | 92.31 | 83.33 | 94.2 | 86.11 | 80.37 | 86.65 | |
| Human (ordinary)Type=Human2026.02 | 86.9 | 66.25 | 85.58 | 71.25 | 81.52 | 89.58 | 69.72 | 78.69 | |
| Gemini-1.5-flashType=Commercial2026.02 | 83.38 | 69.88 | 63.3 | 76.41 | 81.57 | 94.04 | 82 | 78.65 | |
| Gemini-1.5-proType=Commercial2026.02 | 83.07 | 73.86 | 67.2 | 79.97 | 86.27 | 94.88 | 83.08 | 81.19 | |
| Reason-IAD (Qwen3-VL)Type=Reason-IAD, Backbone=Qwen3-VL, Scale=8B2026.02 | 75.24 | 75.07 | 62.78 | 76.38 | 85.58 | 96.31 | 84.62 | 79.43 | |
| Reason-IAD (Qwen3-VL)Type=Reason-IAD, Backbone=Qwen3-VL, Scale=4B2026.02 | 75.05 | 73.72 | 66.48 | 76.83 | 82.33 | 94.9 | 84.41 | 79.1 | |
| Qwen3-VLType=Open Source, Scale=4B2026.02 | 74.02 | 59.25 | 62.74 | 70.09 | 79.22 | 92.47 | 83.59 | 74.48 | |
| Qwen3-VLType=Open Source, Scale=8B2026.02 | 73.08 | 62.33 | 60.34 | 69.15 | 80.09 | 92.53 | 84.01 | 74.51 | |
| GLM-4.1V-ThinkingType=Open Source, Scale=9B2026.02 | 72.31 | 72.01 | 66.47 | 79.98 | 84.61 | 93.79 | 83.26 | 78.92 | |
| Qwen2.5-VLType=Open Source, Scale=7B2026.02 | 71.79 | 55.23 | 68.97 | 64.54 | 78.9 | 92.55 | 84.66 | 72.38 | |
| Reason-IAD (Qwen2.5-VL)Type=Reason-IAD, Backbone=Qwen2.5-VL, Scale=7B2026.02 | 70.74 | 67.97 | 60.82 | 72.78 | 82.62 | 97.17 | 84.99 | 76.73 | |
| Qwen3-VLType=Open Source, Scale=2B2026.02 | 70.29 | 50.42 | 49.35 | 64.69 | 78.09 | 91.45 | 80.43 | 69.24 | |
| GPT-4oType=Commercial2026.02 | 68.63 | 65.8 | 55.62 | 73.21 | 83.41 | 94.98 | 82.8 | 74.92 | |
| InternVL2Type=Open Source, Scale=76B2026.02 | 68.25 | 54.22 | 56.66 | 66.3 | 80.47 | 86.4 | 82.92 | 70.75 | |
| Kimi-VLType=Open Source, Scale=16B2026.02 | 66.57 | 71.72 | 61.88 | 79.78 | 82.93 | 92.18 | 86.51 | 77.37 | |
| AnomalyGPTType=Open Source, Scale=7B2026.02 | 65.57 | 27.49 | 27.97 | 36.86 | 32.11 | 29.84 | 35.82 | 36.52 | |
| GPT-4o-miniType=Commercial2026.02 | 64.1 | 67.35 | 69.07 | 79.02 | 86.72 | 93.96 | 83.37 | 77.65 | |
| Qwen2.5-VLType=Open Source, Scale=3B2026.02 | 63.03 | 47.47 | 54.87 | 66.66 | 80.57 | 86.85 | 82.84 | 68.87 | |
| Reason-IAD (Qwen3-VL)Type=Reason-IAD, Backbone=Qwen3-VL, Scale=2B2026.02 | 61.9 | 70.2 | 54.63 | 71.51 | 79.92 | 94.59 | 81.61 | 73.48 | |
| AnomalyR1Type=Open Source, Scale=3B2026.02 | 60.62 | 63.56 | 70.14 | 80.47 | 85.28 | 92.48 | 86.15 | 76.96 | |
| Claude-3.5-sonnetType=Commercial2026.02 | 60.14 | 60.14 | 48.81 | 67.13 | 79.11 | 85.19 | 79.83 | 68.36 | |
| InternVL2Type=Open Source, Scale=8B2026.02 | 59.97 | 43.85 | 47.91 | 57.6 | 78.1 | 74.18 | 80.37 | 63.14 | |
| LLaVA-NeXTType=Open Source, Scale=34B2026.02 | 57.92 | 48.79 | 52.87 | 71.34 | 80.28 | 81.12 | 77.8 | 67.16 | |
| LLaVA-NeXTType=Open Source, Scale=7B2026.02 | 57.64 | 33.79 | 47.72 | 51.84 | 67.93 | 81.39 | 74.91 | 59.32 | |
| Qwen3-VL-thinkingType=Open Source, Scale=8B2026.02 | 52.31 | 41.5 | 40.37 | 45.67 | 36.02 | 64.34 | 53.3 | 47.64 | |
| LLaVA-OneVisionType=Open Source, Scale=7B2026.02 | 51.77 | 46.13 | 41.85 | 62.19 | 69.73 | 90.31 | 80.93 | 63.27 | |
| LLaVA-1.5Type=Open Source, Scale=7B2026.02 | 51.33 | 37.04 | 36.62 | 50.6 | 69.79 | 68.29 | 69.53 | 54.74 | |
| Random ChanceType=Random2026.02 | 50 | 25 | 25 | 25 | 25 | 25 | 25 | 28.57 | |
| LLaVA-1.5Type=Open Source, Scale=13B2026.02 | 49.96 | 38.78 | 46.17 | 58.17 | 73.09 | 73.62 | 70.98 | 58.68 |