List your company
ResearchFormerly WizWand

Visual Question Answering on ScienceQA Image Set

92.53Top-1 AccLLaVa+GPT-4
42.266855.315968.36581.4141Aug 24, 2023Sep 10, 2023Sep 28, 2023Oct 16, 2023Nov 2, 2023Nov 20, 2023Dec 8, 2023
Updated 8mo ago

Evaluation results

MethodLinks
LLaVa+GPT-4mode=specialist2023.0892.53
LyricsBackbone=Vicuna-13B, Evaluation protocol=0-shot2023.1271.1
IDEFICS-80BBackbone=LLaMA-65B, Evaluation protocol=0-shot2023.1268.9
Qwen-VL-Chatzero-shot=true2023.0868.2
Qwen-VLBackbone=Qwen-7B, Evaluation protocol=0-shot2023.1268.2
Qwen-VLzero-shot=true, backbone=Qwen-7B2023.0867.1
InstructBLIPzero-shot=true, backbone=Vicuna-13B2023.0863.1
InstructBLIPBackbone=Vicuna-13B, Evaluation protocol=0-shot2023.1263.1
BLIP-2zero-shot=true, backbone=Vicuna-13B2023.0861
BLIP-2Backbone=Vicuna-13B, Evaluation protocol=0-shot2023.1261
IDEFICS-9BBackbone=LLaMA-7B, Evaluation protocol=0-shot2023.1244.2