Visual Question Answering on OK-VQA v1.0 (test)
85.6AccuracyProMSA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ProMSAModel=Qwen3-VL-8B2026.06 | 85.6 | — | — | — | — | — | |
| ProMSAModel=Qwen2.5-VL-7B2026.06 | 82.7 | — | — | — | — | — | |
| CC-VQAModel=Qwen2.5-VL-7B2026.06 | 78.8 | — | — | — | — | — | |
| Wiki-PRE-7BModel=Qwen2.5-VL-7B2026.06 | 77.8 | — | — | — | — | — | |
| MMKB-RAGModel=LLaMA-3.1-8B2026.06 | 65.4 | — | — | — | — | — | |
| REVIVEModel Configuration=Ensemble, Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2022.06 | 58 | — | — | — | — | — | |
| Ours (visualBERT-based)Implicit Knowledge=visualBERT+OFA+T5, Explicit Knowledge Resources=VQAv2 + Wikipedia, Ensemble=true2023.05 | 56.67 | — | 61.32 | — | — | — | |
| REVIVEModel Configuration=Single, Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2022.06 | 56.6 | — | — | — | — | — | |
| Ours (LXMERT-based)Implicit Knowledge=LXMERT+OFA+T5, Explicit Knowledge Resources=VQAv2 + Wikipedia, Ensemble=true2023.05 | 56.49 | — | 61.12 | — | — | — | |
| Ours (visualBERT-based)Implicit Knowledge=visualBERT+OFA+T5, Explicit Knowledge Resources=VQAv2 + Wikipedia, Ensemble=false2023.05 | 55.52 | — | 60.17 | — | — | — | |
| Ours (LXMERT-based)Implicit Knowledge=LXMERT+OFA+T5, Explicit Knowledge Resources=VQAv2 + Wikipedia, Ensemble=false2023.05 | 55.33 | — | 59.85 | — | — | — | |
| KAT-EnsembleT5=true, GPT-3=true, K_train=40, K_test=40, Knowledge Source=W + GPT-32022.10 | 54.41 | — | — | — | — | — | |
| KATModel Configuration=Ensemble, Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2022.06 | 54.4 | — | — | — | — | — | |
| KATModel Configuration=Single, Knowledge Resources=Wikidata+Frozen GPT-3 (175B)2022.06 | 53.1 | — | — | — | — | — | |
| RA-VQA-NoPRT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (full)2022.10 | 52.98 | 77.67 | 57.8 | — | — | — | |
| RA-VQA-NoCTT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (full)2022.10 | 52.67 | 83.77 | 57.51 | — | — | — | |
| KAT-Knowledge-T5T5=true, GPT-3=true, K_train=40, K_test=40, Knowledge Source=W + GPT-32022.10 | 51.97 | — | — | — | — | — | |
| RA-VQA-FrDPR-NoCTT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (full)2022.10 | 50.66 | 81.25 | 54.99 | — | — | — | |
| TRiG-EnsembleT5=true, GPT-3=false, K_train=100, K_test=100, Knowledge Source=W2022.10 | 50.5 | — | 54.73 | — | — | — | |
| TRiGImplicit Knowledge=T5, Explicit Knowledge Resources=Wikipedia, Ensemble=true2023.05 | 50.5 | — | 54.73 | — | — | — | |
| TRiGT5=true, GPT-3=false, K_train=100, K_test=100, Knowledge Source=W2022.10 | 49.35 | — | 53.59 | — | — | — | |
| TRiGImplicit Knowledge=T5, Explicit Knowledge Resources=Wikipedia, Ensemble=false2023.05 | 49.35 | — | 53.59 | — | — | — | |
| PICaModel Configuration=Full, Knowledge Resources=Frozen GPT-3 (175B)2022.06 | 48 | — | — | — | — | — | |
| PICaT5=false, GPT-3=true, Knowledge Source=GPT-32022.10 | 48 | — | — | — | — | — | |
| TRiGT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=W2022.10 | 45.51 | — | 49.21 | — | — | — | |
| KAT-T5T5=true, GPT-3=false, K_train=40, K_test=40, Knowledge Source=W2022.10 | 44.25 | — | — | — | — | — | |
| PICaModel Configuration=Base, Knowledge Resources=Frozen GPT-3 (175B)2022.06 | 43.3 | — | — | — | — | — | |
| MUKEAImplicit Knowledge=LXMERT, Explicit Knowledge Resources=multimodal knowledge from VQAv2 and OK-VQA2023.05 | 42.59 | — | — | — | — | — | |
| MAVEXImplicit Knowledge=ViLBERT, Explicit Knowledge Resources=Wikipedia + ConceptNet + Google Images2023.05 | 41.37 | — | — | — | — | — | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=80M2023.10 | 39.79 | — | — | 115 | 18 | 15.68 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=250M2023.10 | 39.79 | — | — | 81 | 11 | 22.13 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=780M2023.10 | 39.79 | — | — | 115 | 18 | 15.68 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=3B2023.10 | 39.79 | — | — | 151 | 18 | 15.68 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=Galactica (T*), Decomposer Params=7B2023.10 | 39.79 | — | — | 137 | 24 | 12.54 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=FLAN-T5 (T), Decomposer Params=11B2023.10 | 39.79 | — | — | 166 | 21 | 13.98 | |
| Selective DecompositionVQA Model=BLIP-2 13B, Decomposer=BLIP-2 (I+T), Decomposer Params=11B2023.10 | 39.79 | — | — | 168 | 24 | 12.54 | |
| MAVExKnowledge Resources=Wikipedia+ConceptNet+Google Images2022.06 | 39.4 | — | — | — | — | — | |
| MAVExT5=false, GPT-3=false, Knowledge Source=W + C + GI2022.10 | 39.4 | — | — | — | — | — | |
| Visual Retriever-ReaderKnowledge Resources=Google Search2022.06 | 39.2 | — | — | — | — | — | |
| VRR-EReaderImplicit Knowledge=ROBERTa, Explicit Knowledge Resources=Google Search2023.05 | 39.2 | — | — | — | — | — | |
| RVLESKImplicit Knowledge=LXMERT, Explicit Knowledge Resources=ConceptNet2023.05 | 39.04 | — | — | — | — | — | |
| KRISP (w/ mm pre.)Implicit Knowledge=BERT, Explicit Knowledge Resources=DBpedia + ConceptNet + VisualGenome + haspartKB + VQAv22023.05 | 38.9 | — | — | — | — | — | |
| KRISPKnowledge Resources=Wikipedia + ConceptNet2022.06 | 38.4 | — | — | — | — | — | |
| KRISPcomponents=VQA joint graph and transformer pre-training2020.12 | 38.35 | — | — | — | — | — | |
| KRISPT5=false, GPT-3=false, Knowledge Source=C + W2022.10 | 38.35 | — | — | — | — | — | |
| VRR-CReaderImplicit Knowledge=LXMERT, Explicit Knowledge Resources=Google Search2023.05 | 36.78 | — | — | — | — | — | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=80M2023.10 | 36.54 | — | — | 59 | 15 | 16.69 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=250M2023.10 | 36.54 | — | — | 46 | 13 | 18.05 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=780M2023.10 | 36.54 | — | — | 67 | 26 | 11.02 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=3B2023.10 | 36.54 | — | — | 97 | 23 | 12.09 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=BLIP-2 (I+T), Decomposer Params=3B2023.10 | 36.54 | — | — | 129 | 27 | 10.7 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=Galactica (T*), Decomposer Params=7B2023.10 | 36.54 | — | — | 73 | 15 | 16.69 | |
| Selective DecompositionVQA Model=BLIP-2 3B, Decomposer=FLAN-T5 (T), Decomposer Params=11B2023.10 | 36.54 | — | — | 103 | 22 | 12.47 | |
| ConceptBERTKnowledge Resources=ConceptNet2022.06 | 33.7 | — | — | — | — | — | |
| ConceptBERT2020.12 | 33.66 | — | — | — | — | — | |
| ConceptBERTT5=false, GPT-3=false, Knowledge Source=C2022.10 | 33.66 | — | — | — | — | — | |
| ConceptBertImplicit Knowledge=BERT, Explicit Knowledge Resources=ConceptNet2023.05 | 33.66 | — | — | — | — | — | |
| KRISP (w/o mm pre.)Implicit Knowledge=BERT, Explicit Knowledge Resources=DBpedia + ConceptNet + VisualGenome + haspartKB2023.05 | 32.31 | — | — | — | — | — | |
| LXMERTImplicit Knowledge=LXMERT, Explicit Knowledge Resources=None2023.05 | 32.04 | — | — | — | — | — | |
| ViLBERTImplicit Knowledge=ViLBERT, Explicit Knowledge Resources=None2023.05 | 31.35 | — | — | — | — | — | |
| KM4Implicit Knowledge=None, Explicit Knowledge Resources=multimodal knowledge from OK-VQA2023.05 | 31.32 | — | — | — | — | — | |
| GRUCImplicit Knowledge=None, Explicit Knowledge Resources=ConceptNet2023.05 | 29.87 | — | — | — | — | — | |
| MuckoImplicit Knowledge=None, Explicit Knowledge Resources=ConceptNet2023.05 | 29.2 | — | — | — | — | — | |
| MUTAN+ANcomponents=AN2020.12 | 27.84 | — | — | — | — | — | |
| MUTAN + ANImplicit Knowledge=None, Explicit Knowledge Resources=Wikipedia2023.05 | 27.84 | — | — | — | — | — | |
| MUTAN+ANKnowledge Resources=Wikipedia2022.06 | 27.8 | — | — | — | — | — | |
| BAN+KG-Augcomponents=KG-Aug2020.12 | 26.71 | — | — | — | — | — | |
| BAN + KG-AUCImplicit Knowledge=None, Explicit Knowledge Resources=Wikipedia + ConceptNet2023.05 | 26.71 | — | — | — | — | — | |
| BAN+KG-AUGKnowledge Resources=Wikipedia+ConceptNet2022.06 | 26.7 | — | — | — | — | — | |
| MUTAN2020.12 | 26.41 | — | — | — | — | — | |
| MUTANImplicit Knowledge=None, Explicit Knowledge Resources=None2023.05 | 26.41 | — | — | — | — | — | |
| MUTANKnowledge Resources=None2022.06 | 26.4 | — | — | — | — | — | |
| BAN+ANcomponents=AN2020.12 | 25.61 | — | — | — | — | — | |
| BAN + ANImplicit Knowledge=None, Explicit Knowledge Resources=Wikipedia2023.05 | 25.61 | — | — | — | — | — | |
| BAN+ANKnowledge Resources=Wikipedia2022.06 | 25.6 | — | — | — | — | — | |
| BAN2020.12 | 25.17 | — | — | — | — | — | |
| BANImplicit Knowledge=None, Explicit Knowledge Resources=None2023.05 | 25.17 | — | — | — | — | — | |
| BANKnowledge Resources=None2022.06 | 25.1 | — | — | — | — | — | |
| MLPKnowledge Resources=None2022.06 | 20.7 | — | — | — | — | — | |
| MLP2020.12 | 20.67 | — | — | — | — | — | |
| Q-Onlymode=Question-Only2020.12 | 14.93 | — | — | — | — | — | |
| Q onlyKnowledge Resources=None2022.06 | 14.9 | — | — | — | — | — | |
| RA-VQAT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (trn/full)2022.10 | — | 82.84 | 58.72 | — | — | — | |
| RA-VQAT5=true, GPT-3=false, K_train=5, K_test=50, Knowledge Source=GS (trn/full)2022.10 | — | 96.55 | 59.41 | — | — | — | |
| RA-VQA-FrDPRT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (trn/full)2022.10 | — | 81.25 | 55.77 | — | — | — | |
| RAGT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (trn/full)2022.10 | — | 82.34 | 52.52 | — | — | — | |
| TRiGT5=true, GPT-3=false, K_train=5, K_test=5, Knowledge Source=GS (trn/full)2022.10 | — | — | 52.79 | — | — | — |