List your company
ResearchFormerly WizWand

Visual Question Answering on SEED-Bench (Accuracy)

94.5AccuracyDDP
35.32450.68766.0581.413Apr 6, 2026Apr 16, 2026Apr 27, 2026May 8, 2026May 19, 2026May 30, 2026Jun 10, 2026
Updated 4mo ago

Evaluation results

MethodLinks
DDPbackbone=Gemini-3-Pro2026.0494.5
Gemini-3-pro2026.0487.2
GPT-4o2026.0477.1
Gemini-1.5-pro2026.0477.1
GRIPModel=Qwen2.5-VL-7B2026.0671.4
ViTModel=Qwen2.5-VL-7B2026.0670.2
DINOModel=Qwen2.5-VL-7B2026.0669.8
Zero ShotModel=Qwen2.5-VL-7B2026.0669.5
CLIPModel=Qwen2.5-VL-7B2026.0669.2
GRIPModel=Idefics2-8B2026.0668.2
ViTModel=Idefics2-8B2026.0667.4
CLIPModel=Idefics2-8B2026.0666.6
Zero ShotModel=Idefics2-8B2026.0666.3
LLaVA-v1.52026.0466.1
DINOModel=Idefics2-8B2026.0665.4
Qwen-VL2026.0462.3
HyCoCLIP-Btrain samples (M)=20.5, trainable params (M)=149.6, Evaluation protocol=Zero-shot, Training=Trained from scratch2026.0446.3
HAC-S w/ bias tuningtrain samples (M)=13.7, trainable params (M)=0.6, Backbone=CLIP-S2026.0445.6
HAC-S w/ LN tuningtrain samples (M)=13.7, trainable params (M)=0.5, Backbone=CLIP-S2026.0445.5
HAC-S w/ seq. adaptertrain samples (M)=13.7, trainable params (M)=1.1, Backbone=CLIP-S2026.0445.1
HAC-B w/ par. adaptertrain samples (M)=13.7, trainable params (M)=1.2, Evaluation protocol=Zero-shot, Tuning method=par. adapter2026.0445.1
HAC-S w/ par. adaptertrain samples (M)=13.7, trainable params (M)=1.1, Backbone=CLIP-S2026.0444.9
HAC-B w/ seq. adaptertrain samples (M)=13.7, trainable params (M)=1.2, Evaluation protocol=Zero-shot, Tuning method=seq. adapter2026.0444.9
HAC-B w/ LoRAtrain samples (M)=13.7, trainable params (M)=8.0, Evaluation protocol=Zero-shot, Tuning method=LoRA2026.0444.9
CLIP-Strain samples (M)=20.5, trainable params (M)=85.3, Backbone=CLIP-S2026.0444.7
CLIP-Btrain samples (M)=20.5, trainable params (M)=149.6, Evaluation protocol=Zero-shot, Training=Trained from scratch2026.0444.7
HAC-S w/ LoRAtrain samples (M)=13.7, trainable params (M)=11.5, Backbone=CLIP-S2026.0444.6
HAC-B w/ LN tuningtrain samples (M)=13.7, trainable params (M)=0.7, Evaluation protocol=Zero-shot, Tuning method=LN tuning2026.0444.5
HAC-B w/ bias tuningtrain samples (M)=13.7, trainable params (M)=0.8, Evaluation protocol=Zero-shot, Tuning method=bias tuning2026.0444.4
HyCoCLIP-Strain samples (M)=20.5, trainable params (M)=85.3, Backbone=CLIP-S2026.0443.9
MERU-Btrain samples (M)=12.0, trainable params (M)=149.6, Evaluation protocol=Zero-shot, Training=Trained from scratch2026.0438
MERU-Strain samples (M)=12.0, trainable params (M)=85.3, Backbone=CLIP-S2026.0437.6