List your company
ResearchFormerly WizWand

Compositional Visual Question Answering on WHOOPS! Compositional VQA

67.8VQA BEMGPT4V
37.84845.62453.461.176Nov 27, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT4VPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.1167.8
GPT4VPrompting Strategy=Zero-Shot CoT2023.1165.5
GPT4VPrompting Strategy=Base2023.1164.8
InstructBLIP-13BPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.1162.9
SphinxPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.1161.9
LLaVA-1.5-13BPrompting Strategy=Compositional Chain-of-Thought (CCoT)2023.1161.2
SphinxPrompting Strategy=Zero-Shot CoT2023.1160.4
BLIP2Prompting Strategy=Base2023.1155
SphinxPrompting Strategy=Base2023.1150
InstructBLIP-13BPrompting Strategy=Base2023.1148.3
LLaVA-1.5-13BPrompting Strategy=Base2023.1147.3
LLaVA-1.5-13BPrompting Strategy=Zero-Shot CoT2023.1146.6
InstructBLIP-13BPrompting Strategy=Zero-Shot CoT2023.1143.36
BLIPPrompting Strategy=Base2023.1139