List your company
ResearchFormerly WizWand

Visual Question Answering on VQA v2 (std)

84.3AccuracyPALI (16.9B)
70.88474.36777.8581.333Nov 20, 2022Jan 3, 2023Feb 17, 2023Apr 3, 2023May 17, 2023Jul 1, 2023Aug 15, 2023
Updated 8mo ago

Evaluation results

MethodLinks
PALI (16.9B)#Example=1.6B2023.0484.3
CoCa#Example=4.8B2023.0482.3
Flamingo (80B)#Example=2.3B2023.0482.1
GIT2 (5.1B)#Example=12.9B2023.0481.9
Florence#Example=900M2023.0480.36
SimVLM#Example=1.8B2023.0480.34
GIT#Example=800M2023.0478.8
METERData=16M+, EPIC=true2022.1178.7
VALORL#Example=33.5M, Resolution=3922023.0478.62
X-VLMData=4M+, EPIC=true2022.1178.5
METERData=16M+, EPIC=false2022.1178.4
BLIP#Example=135M2023.0478.32
X-VLMData=16M+, EPIC=true2022.1178.3
X-VLMData=4M+, EPIC=false2022.1178.2
X-VLMData=16M+, EPIC=false2022.1178.2
METERData=4M+, EPIC=true2022.1178
METERData=4M+, EPIC=false2022.1177.9
METER#Example=10M2023.0477.64
Shikra-13Bmode=zero-shot2023.0877.5
UFO#Example=10M2023.0476.76
ALBEFData=16M+, EPIC=true2022.1176.7
VinVL#Example=10M2023.0476.6
ALBEF#Example=20M2023.0476.04
ALBEFData=16M+, EPIC=false2022.1176
Ours-7B-[mix]mode=zero-shot2023.0875.3
ALBEFData=4M+, EPIC=true2022.1175.2
ALBEFData=4M+, EPIC=false2022.1174.6
UNITER#Example=10M2023.0474.02
Oscar#Example=10M2023.0473.82
ViLTData=4M, EPIC=true2022.1171.8
ViLTData=4M, EPIC=false2022.1171.4