Open-Ended Question Answering on MMAD (test)
0.7026ROUGE-1MAU-GPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MAU-GPTNumber of Parameters=4B2026.01 | 0.7026 | 0.4537 | 0.6531 | 0.4773 | |
| Yi-VLNumber of Parameters=6B2026.01 | 0.3044 | 0.1045 | 0.2469 | 0.0414 | |
| InternVL-2.5Number of Parameters=8B2026.01 | 0.2982 | 0.1103 | 0.2367 | 0.044 | |
| Gemma-3Number of Parameters=4B2026.01 | 0.2936 | 0.0905 | 0.2425 | 0.0357 | |
| LLaVA-1.5Number of Parameters=7B2026.01 | 0.2495 | 0.0894 | 0.2008 | 0.0343 | |
| LLaVA-1.5Number of Parameters=13B2026.01 | 0.2459 | 0.0884 | 0.1976 | 0.0332 | |
| AnomalyGPTShot count=4-shot2026.01 | 0.1954 | 0.0521 | 0.1734 | 0.0216 | |
| AnomalyGPTShot count=1-shot2026.01 | 0.1947 | 0.0516 | 0.173 | 0.0216 | |
| AnomalyGPTShot count=3-shot2026.01 | 0.1943 | 0.0519 | 0.1725 | 0.0216 | |
| AnomalyGPTShot count=2-shot2026.01 | 0.1937 | 0.0514 | 0.172 | 0.0217 | |
| UIO2-XlNumber of Parameters=3B2026.01 | 0.1666 | 0.0348 | 0.1556 | 0.0102 | |
| UIO2-LargeNumber of Parameters=1B2026.01 | 0.1312 | 0.0204 | 0.1284 | 0.006 |