List your company
ResearchFormerly WizWand

Visual Question Answering on A-OKVQA v1.0 (test)

53.36AccuracySelective Decomposition
49.543250.534151.52552.5159Oct 25, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=80M2023.1053.361141814.91
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=250M2023.1053.3635922.96
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=780M2023.1053.36521417.93
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=3B2023.1053.361051417.93
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=Galactica (T*), Decomposer Params=7B2023.1053.361481814.91
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=11B2023.1053.361662510.95
Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=BLIP-2 (I+T), Decomposer Params=11B2023.1053.361922510.95
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=80M2023.1049.69791613.57
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=250M2023.1049.69441117.58
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=780M2023.1049.69871812.42
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=3B2023.1049.69114318.13
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=BLIP-2 (I+T), Decomposer Params=3B2023.1049.69122337.71
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=Galactica (T*), Decomposer Params=7B2023.1049.69175318.13
Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=11B2023.1049.69701117.58