PCB Defect Analysis on UniPCB
76.4Accuracy (P2)Gemini2.5-Pro
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini2.5-ProType=Commercial MLLM2026.01 | 76.4 | 68.5 | 71.9 | 69.6 | 66.5 | 67.7 | 69.3 | 64.9 | 23.6 | 70.8 | 64.9 | |
| GPT5-MainType=Commercial MLLM2026.01 | 73.1 | 66.1 | 77 | 71.2 | 72.2 | 70.5 | 71 | 70.5 | 20.2 | 73.7 | 66.5 | |
| PCB-GPTType=Open Source MLLM, Scale=7B2026.01 | 72.5 | 66.4 | 73.4 | 69 | 67.1 | 70.1 | 70 | 67.4 | 51.1 | 65.8 | 67.3 | |
| Qwen3-VL-ThinkType=Open Source MLLM, Scale=8B2026.01 | 65.6 | 54.6 | 64.9 | 65.5 | 58 | 65.6 | 66.5 | 65 | 20.1 | 58.7 | 58.5 | |
| Gemini2.5-FlashType=Commercial MLLM2026.01 | 63.4 | 46.5 | 70.9 | 67.4 | 63.6 | 67.6 | 68.5 | 63.7 | 17 | 69.1 | 59.8 | |
| LLaVA-OVType=Open Source MLLM, Scale=8B2026.01 | 61.6 | 55.4 | 73.2 | 56.7 | 68.7 | 70 | 67.1 | 67.9 | — | 59.8 | 58.1 | |
| Qwen3-VL-InstructType=Open Source MLLM, Scale=8B2026.01 | 61.5 | 48.7 | 64.8 | 66.2 | 64.6 | 65 | 68.2 | 64.1 | 22.2 | 61 | 58.6 | |
| IAD-R1Type=IAD MLLM, Scale=7B2026.01 | 58.9 | 50.1 | 56.9 | 54.7 | 56.4 | 61.3 | 60 | 60.5 | 15.2 | 36 | 51 | |
| InternVL3.5Type=Open Source MLLM, Scale=8B2026.01 | 57.5 | 43.5 | 65.5 | 53.7 | 64.5 | 67.7 | 61.1 | 68 | 19.5 | 55.5 | 55.6 | |
| InternVL2.5Type=Open Source MLLM, Scale=8B2026.01 | 56.7 | 39 | 66 | 64 | 66.6 | 68.1 | 67.7 | 65.6 | 14 | 58.7 | 56.6 | |
| MiniCPM-V4.5Type=Open Source MLLM, Scale=8B2026.01 | 53.9 | 54 | 57.7 | 66.3 | 65.6 | 61 | 67.9 | 67.2 | 15.5 | 58.2 | 56.7 | |
| Qwen2.5-VLType=Open Source MLLM, Scale=7B2026.01 | 53.2 | 44.2 | 66.7 | 50.4 | 63.7 | 68.1 | 60.7 | 66.5 | 22.3 | 54.3 | 55 | |
| InternVL3Type=Open Source MLLM, Scale=8B2026.01 | 52.9 | 47.2 | 64.7 | 56 | 66.1 | 67.2 | 62.1 | 67.5 | 18 | 56.5 | 55.9 | |
| MiMo-V2-FlashType=Open Source MLLM, Scale=15B2026.01 | 40 | 47.7 | 42 | 64 | 45.4 | 57.8 | 67 | 61.4 | 16.1 | 42.6 | 48.4 | |
| EMITType=IAD MLLM, Scale=8B2026.01 | 36.4 | 48.5 | 69.3 | 60 | 70.2 | 69.2 | 67.1 | 70 | 10.5 | 60.2 | 56.1 | |
| DeepSeek2VLType=Open Source MLLM, Scale=16B2026.01 | 17.5 | 24.4 | 57.8 | 47.3 | 53.3 | 64.6 | 62.2 | 63 | — | 39.6 | 43 | |
| AnomalyGPTType=IAD MLLM, Scale=7B2026.01 | 12.9 | 12.3 | 37.4 | 50.1 | 47 | 58.3 | 61.4 | 60 | — | 34.6 | 37.4 |