Open-Ended QA on MMAD
88.75Industrial Components ScoreMAU-GPT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MAU-GPTType=Specialized Model, Parameters=4B2026.01 | 88.75 | 81.66 | 85.64 | 84.37 | 86.97 | 94.39 | 91.05 | |
| Gemma-3Type=Generalist Model, Parameters=4B2026.01 | 31.96 | 54.31 | 40.36 | 39.8 | 50.59 | 42.41 | 43.24 | |
| Yi-VLType=Generalist Model, Parameters=6B2026.01 | 31.47 | 39.73 | 34.96 | 40.89 | 47.84 | 36.59 | 38.58 | |
| InternVL-2.5Type=Generalist Model, Parameters=8B2026.01 | 30.52 | 50.94 | 50.23 | 45.35 | 51.12 | 61.08 | 48.21 | |
| UIO2-XlType=Generalist Model, Parameters=3B2026.01 | 21.29 | 26.6 | 33.92 | 25.39 | 34.02 | 16.9 | 26.35 | |
| LLaVA-1.5Type=Generalist Model, Parameters=13B2026.01 | 18.93 | 34.8 | 32.79 | 29.94 | 41.5 | 41.37 | 33.22 | |
| LLaVA-1.5Type=Generalist Model, Parameters=7B2026.01 | 16.11 | 30.32 | 39.85 | 30.72 | 40.48 | 40.6 | 33.01 | |
| UIO2-LargeType=Generalist Model, Parameters=1B2026.01 | 14.33 | 25.06 | 33.38 | 29.14 | 34.45 | 13.38 | 24.96 | |
| AnomalyGPTType=Specialized Model, Config=4-shot2026.01 | 12.64 | 28.16 | 27.31 | 19.73 | 36.71 | 9.23 | 22.3 | |
| AnomalyGPTType=Specialized Model, Config=3-shot2026.01 | 12 | 29.3 | 27.01 | 19.83 | 36.54 | 9.23 | 22.32 | |
| AnomalyGPTType=Specialized Model, Config=2-shot2026.01 | 11.54 | 31.27 | 26.73 | 19.27 | 36.47 | 9.05 | 22.39 | |
| AnomalyGPTType=Specialized Model, Config=1-shot2026.01 | 11.19 | 29.27 | 25.12 | 17.97 | 37.08 | 9 | 21.61 |