List your company
ResearchFormerly WizWand

Visual Entailment on SNLI-VE

0.91AccuracyOFA
0.0147680.2471840.47960.712016Dec 8, 2021Apr 8, 2022Aug 8, 2022Dec 8, 2022Apr 8, 2023Aug 8, 2023Dec 8, 2023
Updated 4mo ago

Evaluation results

MethodLinks
OFAEvaluation Protocol=Supervised2023.050.91
SimVLMbasepublic data=false2021.120.842
UNITEREvaluation Protocol=Supervised2023.050.794
FLAVApublic data=true2021.120.79
UNITERbasepublic data=true2021.120.783
UNITERInteraction=Fine-grained vision-language interaction2022.090.783
VisualBERTpublic data=true2021.120.773
ERNIE-ViL 2.0Interaction=Shallow cross-modal interaction, Model Type=English pre-trained2022.090.766
ViLBERTpublic data=true2021.120.757
CLIP-ViT-B/16public data=false2021.120.74
CLIP-ViT-B/16 (PMD)public data=true, pretraining dataset=PMD2021.120.735
UniTpublic data=true, config=shared, (COCO init.)2021.120.731
EVE-ImageEvaluation Protocol=Supervised2023.050.716
IdealGPTEvaluation Protocol=Zero-Shot2023.050.553
VLATTACKPre-trained Model=OFA, Attack Modality=Multimodality2023.100.4178
BLIP-2 ViT-G + LSKDEvaluation Protocol=Zero-shot, Backbone=ViT-G2023.120.403
LLaVAEvaluation Protocol=Zero-Shot2023.050.403
CLIP ViT-B-16*Evaluation Protocol=Zero-shot, Backbone=ViT-B-162023.120.36
MiniGPT4Evaluation Protocol=Zero-Shot2023.050.351
BLIP ViT-LEvaluation Protocol=Zero-shot, Backbone=ViT-L2023.120.342
BLIP-2 ViT-GEvaluation Protocol=Zero-shot, Backbone=ViT-G2023.120.334
Random Guess2023.050.333
CLIP ViT-L-14x336Evaluation Protocol=Zero-shot, Backbone=ViT-L-14x3362023.120.319
BLIP-2 ViT-LEvaluation Protocol=Zero-shot, Backbone=ViT-L2023.120.317
BSAPre-trained Model=OFA, Attack Modality=Image Only2023.100.2919
FDAPre-trained Model=OFA, Attack Modality=Image Only2023.100.209
Co-AttackPre-trained Model=OFA, Attack Modality=Multimodality2023.100.1866
SSPPre-trained Model=OFA, Attack Modality=Image Only2023.100.1511
DRPre-trained Model=OFA, Attack Modality=Image Only2023.100.1371
BERT-Attack (B&A)Pre-trained Model=OFA, Attack Modality=Text Only2023.100.1051
R&RPre-trained Model=OFA, Attack Modality=Text Only2023.100.0492