List your company
ResearchFormerly WizWand

Visual Question Answering on OK-VQA full (val)

62.24AccuracyHyper-ICL
29.27237.83146.3954.949Jun 3, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Hyper-ICLModel=Idefics2-8b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.0662.24
MimICModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.0658.74
8-shot ICLModel=Idefics2-8b, Method Type=Direct ICDs2026.0657.68
RICESModel=Idefics2-8b, Method Type=Direct ICDs2026.0655.73
Hyper-ICLModel=Idefics-9b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.0655.31
LoRAModel=Idefics2-8b, Method Type=Learnable, # Params (M)=17.6 (×14.9)2026.0655.05
LIVEModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.0654.86
MimICModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.0652.05
RICESModel=Idefics-9b, Method Type=Direct ICDs2026.0651.11
32-shot ICLModel=Idefics-9b, Method Type=Direct ICDs2026.0648.48
LoRAModel=Idefics-9b, Method Type=Learnable, # Params (M)=25.0 (×21.2)2026.0647.06
LIVEModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.0646.05
Zero-shotModel=Idefics2-8b, Method Type=Direct ICDs2026.0643.08
TVModel=Idefics2-8b, Method Type=Non-Learnable2026.0638.27
FVModel=Idefics2-8b, Method Type=Non-Learnable2026.0634.58
TVModel=Idefics-9b, Method Type=Non-Learnable2026.0632.68
FVModel=Idefics-9b, Method Type=Non-Learnable2026.0631.02
Zero-shotModel=Idefics-9b, Method Type=Direct ICDs2026.0630.54