Compositional Visual Question Answering on WHOOPS! Compositional VQA
67.8VQA BEMGPT4V
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT4VPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.11 | 67.8 | |
| GPT4VPrompting Strategy=Zero-Shot CoT2023.11 | 65.5 | |
| GPT4VPrompting Strategy=Base2023.11 | 64.8 | |
| InstructBLIP-13BPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.11 | 62.9 | |
| SphinxPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.11 | 61.9 | |
| LLaVA-1.5-13BPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.11 | 61.2 | |
| SphinxPrompting Strategy=Zero-Shot CoT2023.11 | 60.4 | |
| BLIP2Prompting Strategy=Base2023.11 | 55 | |
| SphinxPrompting Strategy=Base2023.11 | 50 | |
| InstructBLIP-13BPrompting Strategy=Base2023.11 | 48.3 | |
| LLaVA-1.5-13BPrompting Strategy=Base2023.11 | 47.3 | |
| LLaVA-1.5-13BPrompting Strategy=Zero-Shot CoT2023.11 | 46.6 | |
| InstructBLIP-13BPrompting Strategy=Zero-Shot CoT2023.11 | 43.36 | |
| BLIPPrompting Strategy=Base2023.11 | 39 |