Visual Question Answering on VQA (test-std)
84AccuracyCoCa
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CoCa#Images=3B, Para.=2.1B2022.12 | 84 | — | — | — | — | |
| GIT#Images=0.8B, Para.=0.7B2022.12 | 78.81 | — | — | — | — | |
| X-VLMPre-training Images Scale=16M2021.11 | 78.37 | — | — | — | — | |
| PTP-BLIP#Images=14M, Para.=220M2022.12 | 78.33 | — | — | — | — | |
| BLIPCapFilt-LPre-train #Images=129M2022.01 | 78.32 | — | — | — | — | |
| BLIPPre-train #Images=129M2022.01 | 78.17 | — | — | — | — | |
| SimVLMbase†Pre-train #Images=1.8B2022.01 | 78.14 | — | — | — | — | |
| SimVLM_basePre-training Images Scale=1.8B2021.11 | 78.14 | — | — | — | — | |
| SimVLM#Images=1.8B, Para.=1.2B2022.12 | 78.14 | — | — | — | — | |
| X-VLMPre-training Images Scale=4M2021.11 | 78.09 | — | — | — | — | |
| METER-CLIP2021.11 | 77.64 | — | — | — | — | |
| BLIPPre-train #Images=14M2022.01 | 77.62 | — | — | — | — | |
| BLIP#Images=14M, Para.=220M2022.12 | 77.62 | — | — | — | — | |
| BaselineBase Model=CLIP-ViL, Training Protocol=Re-Pretrain2022.04 | 76.7 | — | — | — | — | |
| VinVL_largePre-training Images Scale=5.6M2021.11 | 76.6 | — | — | — | — | |
| VinVL_L#Images=5.6M, Para.=347M2022.12 | 76.6 | — | — | — | — | |
| METER-Swin2021.11 | 76.42 | — | — | — | — | |
| PTP-BLIP#Images=4M, Para.=220M2022.12 | 76.18 | — | — | — | — | |
| VinVL#Images=6M2022.02 | 76.12 | — | — | — | — | |
| ALBEFPre-training Images=14M2021.07 | 76.04 | — | — | — | — | |
| ALBEFPre-train #Images=14M2022.01 | 76.04 | — | — | — | — | |
| MADBase Model=VILLA, Training Protocol=Only Finetune, Teacher Visual Encoder=CLIP-V, Teacher Text Encoder=CLIP-T2022.04 | 76.04 | — | — | — | — | |
| ALBEFPre-training Images Scale=14M2021.11 | 76.04 | — | — | — | — | |
| ALBEF#Images=14M, Para.=210M2022.12 | 76.04 | — | — | — | — | |
| CoCa-LargeParams (million)=672.12023.10 | 75.3 | — | — | — | — | |
| UNIMOPre-train #Images=5.6M2022.01 | 75.27 | — | — | — | — | |
| UNIMO#Images=5.6M, Para.=307M2022.12 | 75.27 | — | — | — | — | |
| UNIMOModel Size=large2020.12 | 75.27 | — | — | — | — | |
| ERNIE-ViLModel Size=large2020.12 | 74.93 | — | — | — | — | |
| TCL#Images=4M2022.02 | 74.92 | — | — | — | — | |
| ALBEF BaseParams=581, TFLOPS=7.052023.10 | 74.89 | — | — | — | — | |
| VILLAModel size=Large2020.06 | 74.87 | — | — | — | — | |
| BaselineBase Model=VILLA, Training Protocol=Only Finetune2022.04 | 74.87 | — | — | — | — | |
| VillaModel Size=large2020.12 | 74.87 | — | — | — | — | |
| ALBEFPre-training Images=4M2021.07 | 74.7 | — | — | — | — | |
| ALBEF#Images=4M2022.02 | 74.7 | — | — | — | — | |
| ALBEFPre-training Images Scale=4M2021.11 | 74.7 | — | — | — | — | |
| ALBEFParams (million)=241.02023.10 | 74.7 | — | — | — | — | |
| PTP-VILT#Images=4M, Para.=87M2022.12 | 74.36 | — | — | — | — | |
| KD-VLP2021.11 | 74.31 | — | — | — | — | |
| BLIP†#Images=4M, Para.=220M2022.12 | 74.13 | — | — | — | — | |
| CLIP-ViLpParams (million)=187.72023.10 | 74.1 | — | — | — | — | |
| UNITERModel size=Large2020.06 | 74.02 | — | — | — | — | |
| UNIMO#Images=4M2022.02 | 74.02 | — | — | — | — | |
| BaselineBase Model=UNITER, Training Protocol=Only Finetune2022.04 | 74.02 | — | — | — | — | |
| UNITER_large2021.11 | 74.02 | — | — | — | — | |
| UNIMOModel Size=base2020.12 | 74.02 | — | — | — | — | |
| UNITERModel Size=large2020.12 | 74.02 | — | — | — | — | |
| ALBEF PELAParams=259, TFLOPS=2.472023.10 | 73.87 | — | — | — | — | |
| OscarModel size=Large2020.06 | 73.82 | — | — | — | — | |
| OscarModel Size=large2020.12 | 73.82 | — | — | — | — | |
| VILLA-BaseParams (million)=146.52023.10 | 73.7 | — | — | — | — | |
| VILLAModel size=Base2020.06 | 73.67 | — | — | — | — | |
| VILLA2021.07 | 73.67 | — | — | — | — | |
| VILLAPre-train #Images=4M2022.01 | 73.67 | — | — | — | — | |
| VILLA#Images=4M2022.02 | 73.67 | — | — | — | — | |
| VILLA2021.11 | 73.67 | — | — | — | — | |
| E2E-VLP2021.11 | 73.67 | — | — | — | — | |
| VillaModel Size=base2020.12 | 73.67 | — | — | — | — | |
| SOHOPre-train #Images=219K2022.01 | 73.47 | — | — | — | — | |
| SOHO2021.11 | 73.47 | — | — | — | — | |
| OscarModel size=Base2020.06 | 73.44 | — | — | — | — | |
| OSCAR2021.07 | 73.44 | — | — | — | — | |
| OSCARPre-train #Images=4M2022.01 | 73.44 | — | — | — | — | |
| OSCAR#Images=4M2022.02 | 73.44 | — | — | — | — | |
| OSCAR#Images=4M, Para.=155M2022.12 | 73.44 | — | — | — | — | |
| OscarModel Size=base2020.12 | 73.44 | — | — | — | — | |
| Oscar BasePretraining Images=4M2021.02 | 73.4 | — | — | — | — | |
| OSCAR-BaseParams (million)=146.52023.10 | 73.4 | — | — | — | — | |
| UNITERModel size=Base2020.06 | 72.91 | — | — | — | — | |
| UNITER2021.07 | 72.91 | — | — | — | — | |
| UNITERPre-train #Images=4M2022.01 | 72.91 | — | — | — | — | |
| UNITER#Images=4M2022.02 | 72.91 | — | — | — | — | |
| UNITER#Images=4M, Para.=155M2022.12 | 72.91 | — | — | — | — | |
| UNITERParams=116, TFLOPS=0.372023.10 | 72.91 | — | — | — | — | |
| UNITERModel Size=base2020.12 | 72.91 | — | — | — | — | |
| UNITER BasePretraining Images=4M2021.02 | 72.9 | — | — | — | — | |
| UNITER-BaseParams (million)=146.52023.10 | 72.9 | — | — | — | — | |
| ERNIE-ViLModel Size=base2020.12 | 72.85 | — | — | — | — | |
| LXMERT2020.06 | 72.54 | — | — | — | — | |
| LXMERT2021.07 | 72.54 | — | — | — | — | |
| LXMERTPre-train #Images=180K2022.01 | 72.54 | — | — | — | — | |
| LXMERTParams=224, TFLOPS=0.412023.10 | 72.54 | — | — | — | — | |
| LXMERTPretraining Images=180K2021.02 | 72.5 | — | — | — | — | |
| VL-BERTModel size=Large2020.06 | 72.22 | — | — | — | — | |
| BaselineBase Model=VL-BERT, Training Protocol=Only Finetune2022.04 | 72.22 | — | — | — | — | |
| CoCa-Tiny_12 (OPTIMA)Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10 | 71.6 | — | — | — | — | |
| FALCONPre-trained on=MSCOCO2025.05 | 71.36 | — | — | — | — | |
| q = 0.5Pre-trained on=MSCOCO2025.05 | 71.31 | — | — | — | — | |
| VL-BARTPretraining Images=180K2021.02 | 71.3 | — | — | — | — | |
| VL-T5/BARTPre-train #Images=180K2022.01 | 71.3 | — | — | — | — | |
| GRIT-VLPPre-trained on=MSCOCO2025.05 | 71.22 | — | — | — | — | |
| MAFAPre-trained on=MSCOCO2025.05 | 71.22 | — | — | — | — | |
| CoCa-Tiny_12Teacher=CoCa-Large, Params (million)=101.8, Inference Speedup=3.4x2023.10 | 71.2 | — | — | — | — | |
| Progressive-SofteningPre-trained on=MSCOCO2025.05 | 71.17 | — | — | — | — | |
| Progressive-HardeningPre-trained on=MSCOCO2025.05 | 71.15 | — | — | — | — | |
| DiHTPre-trained on=MSCOCO2025.05 | 71.07 | — | — | — | — | |
| SRCLPre-trained on=MSCOCO2025.05 | 71.01 | — | — | — | — | |
| VisualBERT2020.06 | 71 | — | — | — | — | |
| VisualBERT2021.07 | 71 | — | — | — | — |