Visual Question Answering Grounding on GIQA-Bench
84.44Accuracy (Y)Grounding-IQA (mPLUG-Owl2-7B)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Grounding-IQA (mPLUG-Owl2-7B)Group=Ours2024.11 | 84.44 | 60.31 | 73.72 | 58.75 | 74.17 | |
| Grounding-IQA (LLaVA-v1.6-7B)Group=Ours2024.11 | 83.33 | 54.59 | 65.38 | 56.25 | 72.5 | |
| Grounding-IQA (LLaVA-v1.5-13B)Group=Ours2024.11 | 78.89 | 68.3 | 75.64 | 55.42 | 69.5 | |
| Grounding-IQA (LLaVA-v1.5-7B)Group=Ours2024.11 | 77.77 | 51.8 | 59.61 | 54.58 | 68.5 | |
| Q-Instruct (LLaVA-v1.5-7B)Group=IQA2024.11 | 64.44 | — | — | 53.75 | 60.17 | |
| Q-Instruct (LLaVA-v1.5-13B)Group=IQA2024.11 | 62.22 | — | — | 54.17 | 59 | |
| Q-Instruct (mPLUG-Owl2-7B)Group=IQA2024.11 | 61.11 | — | — | 53.75 | 58.17 | |
| mPLUG-Owl2-7BGroup=General2024.11 | 58.89 | — | — | 52.5 | 56.33 | |
| GroundingGPT-7BGroup=Ground2024.11 | 54.44 | 38.45 | 53.21 | 52.5 | 53.67 | |
| Shikra-7BGroup=Ground2024.11 | 53.33 | 41.26 | 43.59 | 39.17 | 47.67 | |
| LLaVA-v1.6-7BGroup=General2024.11 | 48.89 | — | — | 53.33 | 50.67 | |
| LLaVA-v1.5-7BGroup=General2024.11 | 44.44 | — | — | 51.67 | 47.33 | |
| DepictQA-Wild-7BGroup=IQA2024.11 | 43.33 | — | — | 54.58 | 47.83 | |
| Ferret-7BGroup=Ground2024.11 | 41.11 | 53.93 | 57.69 | 48.75 | 44.17 | |
| Kosmos-2-1.6BGroup=Ground2024.11 | 38.89 | 49.82 | 41.03 | 47.5 | 42.33 | |
| LLaVA-v1.5-13BGroup=General2024.11 | 38.88 | — | — | 52.5 | 44.33 |