Quality Description Grounding on GIQA-Bench
22.87BLEU@4Grounding-IQA (mPLUG-Owl2-7B)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Grounding-IQA (mPLUG-Owl2-7B)Group=Ours2024.11 | 22.87 | 59.55 | 54.74 | 63 | |
| Q-Instruct (LLaVA-v1.5-7B)Group=IQA2024.11 | 22.69 | — | — | 58.25 | |
| Q-Instruct (mPLUG-Owl2-7B)Group=IQA2024.11 | 21.46 | — | — | 62 | |
| Grounding-IQA (LLaVA-v1.5-13B)Group=Ours2024.11 | 20.24 | 63.02 | 55.48 | 60.5 | |
| Grounding-IQA (LLaVA-v1.6-7B)Group=Ours2024.11 | 19.17 | 65.83 | 59.81 | 60 | |
| Grounding-IQA (LLaVA-v1.5-7B)Group=Ours2024.11 | 19.02 | 57.63 | 52.83 | 60 | |
| Q-Instruct (LLaVA-v1.5-13B)Group=IQA2024.11 | 19.01 | — | — | 57.25 | |
| mPLUG-Owl2-7BGroup=General2024.11 | 3.62 | — | — | 48.25 | |
| DepictQA-Wild-7BGroup=IQA2024.11 | 3.34 | — | — | 56.5 | |
| Ferret-7BGroup=Ground2024.11 | 3.16 | 64.58 | 67.78 | 43.75 | |
| LLaVA-v1.6-7BGroup=General2024.11 | 3.04 | — | — | 50.5 | |
| LLaVA-v1.5-13BGroup=General2024.11 | 3 | — | — | 49 | |
| LLaVA-v1.5-7BGroup=General2024.11 | 2.82 | — | — | 47 | |
| Kosmos-2-1.6BGroup=Ground2024.11 | 2.63 | 49.46 | 34.48 | 39.25 | |
| GroundingGPT-7BGroup=Ground2024.11 | 1.99 | 49.67 | 53.91 | 32.5 | |
| Shikra-7BGroup=Ground2024.11 | 0.4 | 45.06 | 47.68 | 27 |