List your company
ResearchFormerly WizWand

Cultural Visual Question Answering on CVQA (eval)

5.52Accuracy DeltaConAct
-0.21041.27732.7654.2527Oct 28, 2025
Updated 6mo ago

Evaluation results

MethodLinks
ConActVLM=Qwen2.5-VL-7B, Eval. Setting=Self-Deactivation2025.105.5212.61
ConActVLM=Qwen2.5-VL-7B, Eval. Setting=Self–Cross Gap2025.104.888.36
MADVLM=Qwen2.5-VL-7B, Eval. Setting=Self-Deactivation2025.104.6412.03
LAPEVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Cross-Deactivation Avg.2025.104.4411.28
LAPEVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self-Deactivation2025.104.4311.44
ConActVLM=Pangea-7B, Eval. Setting=Self-Deactivation2025.104.3312.99
MADVLM=Pangea-7B, Eval. Setting=Self-Deactivation2025.104.213.55
ConActVLM=Pangea-7B, Eval. Setting=Self–Cross Gap2025.103.615.65
MADVLM=Qwen2.5-VL-7B, Eval. Setting=Self–Cross Gap2025.103.336.07
MADVLM=Pangea-7B, Eval. Setting=Self–Cross Gap2025.102.864.75
LAPVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Cross-Deactivation Avg.2025.102.7417.74
LAPVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self-Deactivation2025.102.517.82
MADVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self-Deactivation2025.101.467.74
ConActVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self-Deactivation2025.101.399.58
MADVLM=Pangea-7B, Eval. Setting=Cross-Deactivation Avg.2025.101.348.8
MADVLM=Qwen2.5-VL-7B, Eval. Setting=Cross-Deactivation Avg.2025.101.315.96
LAPVLM=Qwen2.5-VL-7B, Eval. Setting=Cross-Deactivation Avg.2025.101.0717.21
RNDVLM=Pangea-7B, Eval. Setting=Self-Deactivation2025.101.026.45
LAPVLM=Pangea-7B, Eval. Setting=Self-Deactivation2025.10124.1
LAPVLM=Qwen2.5-VL-7B, Eval. Setting=Self-Deactivation2025.100.9617.05
MADVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self–Cross Gap2025.100.931.18
LAPVLM=Pangea-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.8923.82
ConActVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self–Cross Gap2025.100.761.95
LAPEVLM=Pangea-7B, Eval. Setting=Self-Deactivation2025.100.746.52
ConActVLM=Pangea-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.727.34
ConActVLM=Qwen2.5-VL-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.644.25
ConActVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.637.63
LAPEVLM=Qwen2.5-VL-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.614.12
LAPEVLM=Qwen2.5-VL-7B, Eval. Setting=Self-Deactivation2025.100.564.64
MADVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.536.56
RNDVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self-Deactivation2025.100.57.01
LAPEVLM=Pangea-7B, Eval. Setting=Self–Cross Gap2025.100.380.34
LAPEVLM=Pangea-7B, Eval. Setting=Cross-Deactivation Avg.2025.100.376.18
LAPVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self–Cross Gap2025.100.240.08
RNDVLM=Qwen2.5-VL-7B, Eval. Setting=Self-Deactivation2025.100.194.66
LAPVLM=Pangea-7B, Eval. Setting=Self–Cross Gap2025.100.110.28
LAPVLM=Qwen2.5-VL-7B, Eval. Setting=Self–Cross Gap2025.100.080.16
LAPEVLM=Qwen2.5-VL-7B, Eval. Setting=Self–Cross Gap2025.100.050.52
LAPEVLM=LLaVA-v1.6-Mistral-7B, Eval. Setting=Self–Cross Gap2025.100.010.15