Science Question Answering on ScienceQA (SQAI)
71.6AccuracyLLaVA-1.5
Evaluation results
| Method | Links | |
|---|---|---|
| LLaVA-1.5LLM=Vicuna-13B, w/G=GPT-42023.11 | 71.6 | |
| LVIS-INSTRUCT4V + mixLLaVA (Ours)LLM=Vicuna-13B, w/G=GPT-4 & 4V2023.11 | 70.6 | |
| LVIS-INSTRUCT4V (Ours)LLM=Vicuna-13B, w/G=GPT-4V2023.11 | 69 | |
| LVIS-INSTRUCT4V (Ours)LLM=Vicuna-7B, w/G=GPT-4V2023.11 | 68.4 | |
| LVIS-INSTRUCT4V + mixLLaVA (Ours)LLM=Vicuna-7B, w/G=GPT-4 & 4V2023.11 | 68.3 | |
| Qwen-VL-chatLLM=Qwen-7B, w/G=Private2023.11 | 68.2 | |
| Qwen-VLLLM=Qwen-7B, w/G=Private2023.11 | 67.1 | |
| LLaVA-1.5LLM=Vicuna-7B, w/G=GPT-42023.11 | 66.8 | |
| InstructBLIPLLM=Vicuna-13B, w/G=GPT-42023.11 | 63.1 | |
| BLIP-2LLM=Vicuna-13B, w/G=None2023.11 | 61 | |
| InstructBLIPLLM=Vicuna-7B, w/G=GPT-42023.11 | 60.5 |