Industrial Anomaly Detection on MMVIAD Standard
91.2Defect DetectionHuman (expert)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Human (expert)2026.05 | 91.2 | 77.8 | 82.3 | 93.7 | 86.3 | |
| Human (ordinary)2026.05 | 87.3 | 67.1 | 78.4 | 91.5 | 81.1 | |
| Gemini 3.1 ProType=Commercial2026.05 | 69.3 | 41.6 | 48.5 | 87.8 | 61.8 | |
| GPT-5.4-miniType=Commercial2026.05 | 68.3 | 32.6 | 46.3 | 64.5 | 52.9 | |
| GPT-5.4Type=Commercial2026.05 | 64.1 | 37.9 | 50.5 | 73 | 56.4 | |
| Time-R1Type=Open Source, Venue=NeurIPS’25, Param.=3B2026.05 | 49.3 | 26.6 | 30.1 | 63.8 | 42.5 | |
| Video-R1Type=Open Source, Venue=NeurIPS’25, Param.=7B2026.05 | 41.4 | 30.6 | 31.1 | 60.9 | 41 | |
| VideoChat-R1Type=Open Source, Venue=arXiv’25, Param.=7B2026.05 | 41.1 | 32.1 | 31.1 | 68.8 | 43.3 | |
| Time-R1Type=Open Source, Venue=NeurIPS’25, Param.=7B2026.05 | 40.8 | 31.3 | 31.1 | 65 | 42.1 | |
| VideoChat-R1.5Type=Open Source, Venue=NeurIPS’25, Param.=7B2026.05 | 36.7 | 30.9 | 31.1 | 66.2 | 41.2 | |
| Qwen3-VLType=Open Source, Venue=arXiv’25, Param.=8B2026.05 | 35.1 | 31 | 30.9 | 69.5 | 41.6 | |
| Qwen3-VLType=Open Source, Venue=arXiv’25, Param.=2B2026.05 | 33.9 | 12.4 | 20.7 | 51.8 | 29.7 | |
| Qwen3-VLType=Open Source, Venue=arXiv’25, Param.=4B2026.05 | 33.9 | 31 | 31.9 | 65.8 | 40.7 |