# Open-Ended Question Answering on MMAD (test) Source: [Open-Ended Question Answering on MMAD (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:00:37.479Z Evaluation of model performance on the test split of the MMAD dataset for Open-Ended Question Answering, typically measured using ROUGE and BLEU scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Open-Ended Question Answering | | Dataset (including any stated split) | MMAD (test) | | Metric | ROUGE-1 | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ROUGE-1](): Higher is better; unit: SCALAR. - [ROUGE-2](): Higher is better; unit: SCALAR. - [ROUGE-L](): Higher is better; unit: SCALAR. - [BLEU-4](): Higher is better; unit: SCALAR. ## Recorded results | Method | ROUGE-1 | Result date | Report paper | | --- | --- | --- | --- | | MAU-GPT | 0.7026 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | Yi-VL | 0.3044 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | InternVL-2.5 | 0.2982 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | Gemma-3 | 0.2936 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | LLaVA-1.5 | 0.2495 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | LLaVA-1.5 | 0.2459 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 0.1954 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 0.1947 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 0.1943 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | AnomalyGPT | 0.1937 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | UIO2-Xl | 0.1666 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | | UIO2-Large | 0.1312 | Not recorded | 698abba8c97a0b3e3b5ddfe6 | ### MAU-GPT ROUGE-1: 0.7026. Result ID: 69976ab05698665ec4be4957. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Number of Parameters":"4B"}. This record does not assert independent reproduction. ### Yi-VL ROUGE-1: 0.3044. Result ID: 69976ab05698665ec4be4951. [Reporting paper]() Recorded evaluation configuration: {"Number of Parameters":"6B"}. This record does not assert independent reproduction. ### InternVL-2.5 ROUGE-1: 0.2982. Result ID: 69976ab05698665ec4be4952. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of Parameters":"8B"}. This record does not assert independent reproduction. ### Gemma-3 ROUGE-1: 0.2936. Result ID: 69976ab05698665ec4be4950. [Reporting paper]() Recorded evaluation configuration: {"Number of Parameters":"4B"}. This record does not assert independent reproduction. ### LLaVA-1.5 ROUGE-1: 0.2495. Result ID: 69976ab05698665ec4be494c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of Parameters":"7B"}. This record does not assert independent reproduction. ### LLaVA-1.5 ROUGE-1: 0.2459. Result ID: 69976ab05698665ec4be494d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Number of Parameters":"13B"}. This record does not assert independent reproduction. ### AnomalyGPT ROUGE-1: 0.1954. Result ID: 69976ab05698665ec4be4956. [Reporting paper]() Recorded evaluation configuration: {"Shot count":"4-shot"}. This record does not assert independent reproduction. ### AnomalyGPT ROUGE-1: 0.1947. Result ID: 69976ab05698665ec4be4953. [Reporting paper]() Recorded evaluation configuration: {"Shot count":"1-shot"}. This record does not assert independent reproduction. ### AnomalyGPT ROUGE-1: 0.1943. Result ID: 69976ab05698665ec4be4955. [Reporting paper]() Recorded evaluation configuration: {"Shot count":"3-shot"}. This record does not assert independent reproduction. ### AnomalyGPT ROUGE-1: 0.1937. Result ID: 69976ab05698665ec4be4954. [Reporting paper]() Recorded evaluation configuration: {"Shot count":"2-shot"}. This record does not assert independent reproduction. ### UIO2-Xl ROUGE-1: 0.1666. Result ID: 69976ab05698665ec4be494f. [Reporting paper]() Recorded evaluation configuration: {"Number of Parameters":"3B"}. This record does not assert independent reproduction. ### UIO2-Large ROUGE-1: 0.1312. Result ID: 69976ab05698665ec4be494e. [Reporting paper]() Recorded evaluation configuration: {"Number of Parameters":"1B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.