# Open-Ended QA on MMAD Source: [Open-Ended QA on MMAD]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:47:06.335Z Evaluation of model performance on the MMAD dataset for Open-Ended Question Answering, reporting category-specific scores across various component types (Industrial, Electronic, Construction, Mechanical, Consumer, Optical). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Open-Ended QA | | Dataset (including any stated split) | MMAD | | Metric | Industrial Components Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Industrial Components Score](): Higher is better; unit: PERCENT. - [Electronic Components Score](): Higher is better; unit: PERCENT. - [Construction Materials Score](): Higher is better; unit: PERCENT. - [Mechanical Parts Score](): Higher is better; unit: PERCENT. - [Consumer Products Score](): Higher is better; unit: PERCENT. - [Optical Inspection Score](): Higher is better; unit: PERCENT. - [Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Industrial Components Score | Result date | Report paper | | --- | --- | --- | --- | | MAU-GPT | 88.75 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | Gemma-3 | 31.96 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | Yi-VL | 31.47 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | InternVL-2.5 | 30.52 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | UIO2-Xl | 21.29 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | LLaVA-1.5 | 18.93 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | LLaVA-1.5 | 16.11 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | UIO2-Large | 14.33 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 12.64 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 12 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 11.54 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 11.19 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | ### MAU-GPT Industrial Components Score: 88.75. Result ID: 69976ab05698665ec4be4963. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Specialized Model","Parameters":"4B"}. This record does not assert independent reproduction. ### Gemma-3 Industrial Components Score: 31.96. Result ID: 69976ab05698665ec4be495c. [Reporting paper]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"4B"}. This record does not assert independent reproduction. ### Yi-VL Industrial Components Score: 31.47. Result ID: 69976ab05698665ec4be495d. [Reporting paper]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"6B"}. This record does not assert independent reproduction. ### InternVL-2.5 Industrial Components Score: 30.52. Result ID: 69976ab05698665ec4be495e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"8B"}. This record does not assert independent reproduction. ### UIO2-Xl Industrial Components Score: 21.29. Result ID: 69976ab05698665ec4be495b. [Reporting paper]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"3B"}. This record does not assert independent reproduction. ### LLaVA-1.5 Industrial Components Score: 18.93. Result ID: 69976ab05698665ec4be4959. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"13B"}. This record does not assert independent reproduction. ### LLaVA-1.5 Industrial Components Score: 16.11. Result ID: 69976ab05698665ec4be4958. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"7B"}. This record does not assert independent reproduction. ### UIO2-Large Industrial Components Score: 14.33. Result ID: 69976ab05698665ec4be495a. [Reporting paper]() Recorded evaluation configuration: {"Type":"Generalist Model","Parameters":"1B"}. This record does not assert independent reproduction. ### AnomalyGPT Industrial Components Score: 12.64. Result ID: 69976ab05698665ec4be4962. [Reporting paper]() Recorded evaluation configuration: {"Type":"Specialized Model","Config":"4-shot"}. This record does not assert independent reproduction. ### AnomalyGPT Industrial Components Score: 12. Result ID: 69976ab05698665ec4be4961. [Reporting paper]() Recorded evaluation configuration: {"Type":"Specialized Model","Config":"3-shot"}. This record does not assert independent reproduction. ### AnomalyGPT Industrial Components Score: 11.54. Result ID: 69976ab05698665ec4be4960. [Reporting paper]() Recorded evaluation configuration: {"Type":"Specialized Model","Config":"2-shot"}. This record does not assert independent reproduction. ### AnomalyGPT Industrial Components Score: 11.19. Result ID: 69976ab05698665ec4be495f. [Reporting paper]() Recorded evaluation configuration: {"Type":"Specialized Model","Config":"1-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.