List your company
ResearchFormerly WizWand

VQA (General) on Vision-Language Tasks General VQA

98.4Targeted ASRCroPA
18.11238.95659.880.644Jun 28, 2025
Updated 6mo ago

Evaluation results

MethodLinks
CroPATarget Prompt=metaphor, VLM Backbone=Flamingo2025.0698.4
CroPATarget Prompt=unknown, VLM Backbone=Flamingo2025.0696.8
CroPATarget Prompt=very good, VLM Backbone=Flamingo2025.0696.2
CroPATarget Prompt=too late, VLM Backbone=Flamingo2025.0693
Multi-PTarget Prompt=very good, VLM Backbone=Flamingo2025.0689.4
Multi-PTarget Prompt=metaphor, VLM Backbone=Flamingo2025.0688.8
CroPATarget Prompt=not sure, VLM Backbone=Flamingo2025.0687.6
CroPATarget Prompt=I am sorry, VLM Backbone=Flamingo2025.0686.2
Multi-PTarget Prompt=too late, VLM Backbone=Flamingo2025.0678.8
Multi-PTarget Prompt=unknown, VLM Backbone=Flamingo2025.0672.4
Multi-PTarget Prompt=I am sorry, VLM Backbone=Flamingo2025.0670.2
Multi-PTarget Prompt=not sure, VLM Backbone=Flamingo2025.0665.2
Single-PTarget Prompt=very good, VLM Backbone=Flamingo2025.0639.8
Single-PTarget Prompt=not sure, VLM Backbone=Flamingo2025.0635.4
Single-PTarget Prompt=metaphor, VLM Backbone=Flamingo2025.0632.8
Single-PTarget Prompt=unknown, VLM Backbone=Flamingo2025.0626.4
Single-PTarget Prompt=too late, VLM Backbone=Flamingo2025.0625.2
Single-PTarget Prompt=I am sorry, VLM Backbone=Flamingo2025.0621.2