Visual Question Answering on VQA (test-dev)
78.25Acc (All)BLIPCapFilt-L
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BLIPCapFilt-LPre-train #Images=129M2022.01 | 78.25 | — | — | — | — | |
| BLIPPre-train #Images=129M2022.01 | 78.24 | — | — | — | — | |
| X-VLMPre-training Images Scale=16M2021.11 | 78.22 | — | — | — | — | |
| X-VLMPre-training Images Scale=4M2021.11 | 78.07 | — | — | — | — | |
| SimVLMbase†Pre-train #Images=1.8B2022.01 | 77.87 | — | — | — | — | |
| SimVLM_basePre-training Images Scale=1.8B2021.11 | 77.87 | — | — | — | — | |
| METER-CLIP2021.11 | 77.68 | — | — | — | — | |
| BLIPPre-train #Images=14M2022.01 | 77.54 | — | — | — | — | |
| VinVL_largePre-training Images Scale=5.6M2021.11 | 76.52 | — | — | — | — | |
| METER-Swin2021.11 | 76.43 | — | — | — | — | |
| VinVL#Images=6M2022.02 | 75.95 | — | — | — | — | |
| ALBEFPre-training Images=14M2021.07 | 75.84 | — | — | — | — | |
| ALBEFPre-train #Images=14M2022.01 | 75.84 | — | — | — | — | |
| ALBEFPre-training Images Scale=14M2021.11 | 75.84 | — | — | — | — | |
| UNIMOPre-train #Images=5.6M2022.01 | 75.06 | — | — | — | — | |
| TCL#Images=4M2022.02 | 74.9 | — | — | — | — | |
| VILLAModel size=Large2020.06 | 74.69 | — | — | — | — | |
| ALBEFPre-training Images=4M2021.07 | 74.54 | — | — | — | — | |
| ALBEF#Images=4M2022.02 | 74.54 | — | — | — | — | |
| ALBEFPre-training Images Scale=4M2021.11 | 74.54 | — | — | — | — | |
| KD-VLP2021.11 | 74.2 | — | — | — | — | |
| UNITERModel size=Large2020.06 | 73.82 | — | — | — | — | |
| UNITER_large2021.11 | 73.82 | — | — | — | — | |
| OscarModel size=Large2020.06 | 73.61 | — | — | — | — | |
| VILLAModel size=Base2020.06 | 73.59 | — | — | — | — | |
| VILLA2021.07 | 73.59 | — | — | — | — | |
| VILLAPre-train #Images=4M2022.01 | 73.59 | — | — | — | — | |
| VILLA#Images=4M2022.02 | 73.59 | — | — | — | — | |
| VILLA2021.11 | 73.59 | — | — | — | — | |
| UNIMO#Images=4M2022.02 | 73.29 | — | — | — | — | |
| SOHOPre-train #Images=219K2022.01 | 73.25 | — | — | — | — | |
| SOHO2021.11 | 73.25 | — | — | — | — | |
| E2E-VLP2021.11 | 73.25 | — | — | — | — | |
| OscarModel size=Base2020.06 | 73.16 | — | — | — | — | |
| OSCAR2021.07 | 73.16 | — | — | — | — | |
| OSCARPre-train #Images=4M2022.01 | 73.16 | — | — | — | — | |
| OSCAR#Images=4M2022.02 | 73.16 | — | — | — | — | |
| 12-in-12020.06 | 73.15 | — | — | — | — | |
| 12-in-12021.07 | 73.15 | — | — | — | — | |
| 12-in-1training=multi-task2019.12 | 72.7 | — | — | — | — | |
| UNITERModel size=Base2020.06 | 72.7 | — | — | — | — | |
| UNITER2021.07 | 72.7 | — | — | — | — | |
| UNITERPre-train #Images=4M2022.01 | 72.7 | — | — | — | — | |
| UNITER#Images=4M2022.02 | 72.7 | — | — | — | — | |
| LXMERT2020.06 | 72.42 | — | — | — | — | |
| LXMERT2021.07 | 72.42 | — | — | — | — | |
| LXMERTPre-train #Images=180K2022.01 | 72.42 | — | — | — | — | |
| VL-BERTModel size=Large2020.06 | 71.79 | — | — | — | — | |
| VL-BART/T52021.07 | 71.3 | — | — | — | — | |
| ViLT#Images=4M2022.02 | 71.26 | — | — | — | — | |
| VL-BERTModel size=Base2020.06 | 71.16 | — | — | — | — | |
| VL-BERT2021.07 | 71.16 | — | — | — | — | |
| VL-BERT2021.11 | 71.16 | — | — | — | — | |
| ViLT2021.07 | 70.94 | — | — | — | — | |
| VisualBERT2020.06 | 70.8 | — | — | — | — | |
| VisualBERT2021.07 | 70.8 | — | — | — | — | |
| ViLBERT2020.06 | 70.55 | — | — | — | — | |
| ViLBERT2021.11 | 70.55 | — | — | — | — | |
| Full fine-tuning2021.12 | 69.9 | — | — | — | — | |
| HDCtraining=multi-task2019.12 | 69.28 | — | — | — | — | |
| Single Adapter2021.12 | 68.1 | — | — | — | — | |
| Hyperformer2021.12 | 67.5 | — | — | — | — | |
| MUTANEnsemble size (n)=52017.05 | 67.42 | 85.14 | 39.81 | 58.52 | — | |
| Multiple LoRA2021.12 | 67.4 | — | — | — | — | |
| MUTANEnsemble size (n)=32017.05 | 67.03 | 84.54 | 39.32 | 57.36 | — | |
| Single LoRA2021.12 | 67 | — | — | — | — | |
| MLBEnsemble size (n)=72017.05 | 66.77 | 84.57 | 39.21 | 57.81 | — | |
| MCBEnsemble size (n)=72017.05 | 66.7 | 83.4 | 39.8 | 58.5 | — | |
| Multiple Adapters2021.12 | 66.7 | — | — | — | — | |
| Half-shared Adapters2021.12 | 66.6 | — | — | — | — | |
| Multiple Compacters2021.12 | 66.5 | — | — | — | — | |
| Single Compacter2021.12 | 66.4 | — | — | — | — | |
| QGHC+MUTAN2018.08 | 64 | 82.96 | 37.16 | 53.88 | — | |
| QGHC+concat2018.08 | 63.86 | 82.54 | 36.94 | 54 | — | |
| QGHC#parameters=5.4M2018.08 | 63.48 | 82.39 | 37.36 | 53.24 | — | |
| DPPnetGRU pre-training=true, CNN fine-tuning=true2015.11 | 62.48 | 80.79 | 38.94 | 52.16 | — | |
| MFB2018.08 | 62.2 | 81.8 | 36.7 | 51.2 | — | |
| CNN-FIXEDGRU pre-training=true, CNN fine-tuning=false2015.11 | 61.95 | 80.56 | 38.32 | 51.4 | — | |
| HieCoAtt2017.05 | 61.8 | 79.7 | 38.7 | 51.7 | — | |
| MRN2017.05 | 61.68 | 82.28 | 38.82 | 49.25 | — | |
| RAND-GRUGRU pre-training=false, CNN fine-tuning=false, dynamic parameter prediction=true2015.11 | 61.18 | 79.64 | 38.07 | 50.63 | — | |
| MUTAN+MLB#parameters=17.5M2018.08 | 61.02 | 82.29 | 37.27 | 48.23 | — | |
| DMN+2016.03 | 60.3 | 80.5 | 36.8 | 48.3 | — | |
| MUTAN#parameters=4.9M2018.08 | 60.17 | 81.45 | 37.32 | 47.17 | — | |
| MLB#parameters=7.7M2018.08 | 60.08 | 82.02 | 36.61 | 46.65 | — | |
| CONCATDescription=Basic model using two fully-connected layers for combined CNN and GRU features2015.11 | 59.92 | 77.1 | 37.48 | 50.31 | — | |
| MCB#parameters=32M2018.08 | 59.4 | 80.81 | 35.91 | 46.43 | — | |
| D-NMN2017.05 | 59.4 | 81.1 | 38.6 | 45.5 | — | |
| FDA2016.04 | 59.24 | 81.14 | 36.16 | 45.77 | — | |
| ACK2017.05 | 59.17 | 81.01 | 38.42 | 45.23 | — | |
| Q+I2015.11 | 58.97 | 75.59 | 34.35 | 50.33 | — | |
| Concat2018.08 | 58.91 | 79.25 | 36.18 | 46.69 | — | |
| SAN(2, CNN)layers=2, backbone=CNN2015.11 | 58.7 | 79.3 | 36.6 | 46.1 | — | |
| SAN2016.04 | 58.7 | 79.3 | 36.6 | 46.1 | — | |
| SAN2017.05 | 58.7 | 79.3 | 36.6 | 46.1 | — | |
| SAN2016.03 | 58.7 | 79.3 | 36.6 | 46.1 | — | |
| Ask Your Neur.2017.05 | 58.39 | 78.39 | 36.45 | 46.28 | — | |
| SMem-VQA Two-Hop2015.11 | 57.99 | 80.87 | 37.32 | 43.12 | — | |
| SMem 2-hop2017.05 | 57.99 | 80.87 | 37.32 | 43.12 | — | |
| D-NMN2016.04 | 57.9 | 80.5 | 37.4 | 43.1 | — |