Knowledge-Based Visual Question Answering on OK-VQA v1.0 (test)
61.2AccuracyOurs + MCAN
Evaluation Results
| Method | Links | |
|---|---|---|
| Ours + MCANKnowledge Resources=Frozen LLaMA 2 (13B)2023.10 | 61.2 | |
| ProphetKnowledge Resources=Frozen GPT-3 (175B)2023.10 | 61.1 | |
| Ours + MCANKnowledge Resources=Frozen LLaMA (13B)2023.10 | 60.02 | |
| OursKnowledge Resources=Frozen LLaMA 2 (13B)2023.10 | 59.07 | |
| OursKnowledge Resources=Frozen LLaMA (13B)2023.10 | 58.69 | |
| REVIVE_large (ensemble)Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2023.10 | 58 | |
| Flamingo (80B)Knowledge Resources=Multimodal Pretraining2023.10 | 57.8 | |
| REVIVE_large (single)Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2023.10 | 56.6 | |
| KAT_large (ensemble)Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2023.10 | 54.41 | |
| Unified-IO (2.8B)Knowledge Resources=Multimodal Pretraining2023.10 | 54 | |
| KAT_large (single)Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2023.10 | 53.09 | |
| KAT_base (single)Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2023.10 | 50.58 | |
| PICa-FullKnowledge Resources=Frozen GPT-3 (175B)2023.10 | 48 | |
| MAVEXKnowledge Resources=Wikipedia+ConceptNet+Google Images2023.10 | 39.4 | |
| KRISPKnowledge Resources=Wikipedia+ConceptNet2023.10 | 38.35 |